-- Logs begin at Wed 2022-08-17 13:34:09 UTC, end at Wed 2022-08-17 14:37:58 UTC. -- Aug 17 14:06:13.855618 dv-cinder-820027-18-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 14:06:13.867359 dv-cinder-820027-18-smb devstack@keystone.service[81585]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 14:06:13 2022] *** Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: nodename: dv-cinder-820027-18-smb Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: machine: x86_64 Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: clock source: unix Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: pcre jit disabled Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: detected number of CPU cores: 4 Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: current working directory: / Aug 17 14:06:13.869987 dv-cinder-820027-18-smb devstack@keystone.service[81585]: detected binary path: /usr/bin/uwsgi-core Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: your processes number limit is 47680 Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: your memory page size is 4096 bytes Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: detected max file descriptor number: 2048 Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: lock engine: pthread robust mutexes Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: thunder lock: enabled Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 14:06:13.870646 dv-cinder-820027-18-smb devstack@keystone.service[81585]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 14:06:13.909856 dv-cinder-820027-18-smb devstack@keystone.service[81585]: Python main interpreter initialized at 0x5614672399c0 Aug 17 14:06:13.909856 dv-cinder-820027-18-smb devstack@keystone.service[81585]: python threads support enabled Aug 17 14:06:13.909856 dv-cinder-820027-18-smb devstack@keystone.service[81585]: your server socket listen backlog is limited to 100 connections Aug 17 14:06:13.909856 dv-cinder-820027-18-smb devstack@keystone.service[81585]: your mercy for graceful operations on workers is 90 seconds Aug 17 14:06:13.910179 dv-cinder-820027-18-smb devstack@keystone.service[81585]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 14:06:13.910281 dv-cinder-820027-18-smb devstack@keystone.service[81585]: *** Operational MODE: preforking *** Aug 17 14:06:13.910554 dv-cinder-820027-18-smb devstack@keystone.service[81585]: *** uWSGI is running in multiple interpreter mode *** Aug 17 14:06:13.910554 dv-cinder-820027-18-smb devstack@keystone.service[81585]: spawned uWSGI master process (pid: 81585) Aug 17 14:06:13.910726 dv-cinder-820027-18-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 17 14:06:13.912261 dv-cinder-820027-18-smb devstack@keystone.service[81585]: spawned uWSGI worker 1 (pid: 81596, cores: 1) Aug 17 14:06:13.912261 dv-cinder-820027-18-smb devstack@keystone.service[81585]: spawned uWSGI worker 2 (pid: 81597, cores: 1) Aug 17 14:06:13.912261 dv-cinder-820027-18-smb devstack@keystone.service[81585]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 14:06:18.171734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:06:18.171734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: from cryptography.utils import int_from_bytes Aug 17 14:06:18.172526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:06:18.172526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: from cryptography.utils import int_from_bytes Aug 17 14:06:18.172942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:06:18.172942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: from cryptography.utils import int_from_bytes Aug 17 14:06:18.173052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:06:18.173052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: from cryptography.utils import int_from_bytes Aug 17 14:06:18.222454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:06:18.222643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:06:18.222737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:06:18.222823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] command line args: [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:06:18.222895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:06:18.223021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] command line args: [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:06:18.223107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:06:18.223246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ================================================================================ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:06:18.223330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:06:18.223454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ================================================================================ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:06:18.223539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] admin_token = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.223708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] admin_token = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.223799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_dir = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.223876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.223968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_dir = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_source = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] debug = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_source = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] debug = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.224973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_config_append = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.225956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_config_append = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_dir = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_dir = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.226946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.227899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.228922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.229915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] publish_errors = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] publish_errors = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.230995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] standard_threads = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.231871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] standard_threads = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_journal = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_journal = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_json = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.232947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_json = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_stderr = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_stderr = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_syslog = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_syslog = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:06:18.233559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.233642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.233795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.233879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.234850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.235828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.236976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237298 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.237961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.238934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.239889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.240944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.241899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.242991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.243067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.243223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.243301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.243449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.243525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.244930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.245934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.246883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.247866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.248918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.249949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.250985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.251915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252431 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.252858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253479 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.253946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.254991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.255853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.256866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.257966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.258949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.external = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.259039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.external = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.259220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.259818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.password = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.password = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.token = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.260843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.token = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.261958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.262995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.263882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.264971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.265925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.266970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.267941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.268916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.269867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.270970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.271912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.272952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.273934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.274915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.275850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.276849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.277928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.278842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.279948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.280989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.281922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.282873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.283986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.284994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.285962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.286896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.287847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.288965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.289988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.290959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.291927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.292895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.293986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.294962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.295906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.296911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.297861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.298994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.299917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.300994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.301912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.302879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.303808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.304926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.305992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.306672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.306761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.306924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.307970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.308912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.309850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.310851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:06:18.310925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:06:18.311076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:06:18.340624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.340762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.340845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.340966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.341049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.341187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.349575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.349713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.378175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.378400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.378491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.378634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.432127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.432366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.481528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.481758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.482375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.482610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.637968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.638999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.639090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.639214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.662994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.663130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.663221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.663345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.663430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.663557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.663771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.674996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.675402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.688194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.688377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.688599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.688693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.688819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.688902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.689906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 14:06:18.706564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.706762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.706850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:06:18.706971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:06:18.707111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.707307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.707404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:06:18.707508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 14:06:18.707588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.707780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.707859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.708068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.708361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.708576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.708654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.708839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.718988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.725863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.725954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.729324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.729472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.729615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.729724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.729900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.730998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.731103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.731271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.731375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.731653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.731767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.731930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.732066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.732223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.732335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.755370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.755471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.756857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.756940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.757142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.757238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.761835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.761918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.762118 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.762198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.762400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.762482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.768749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.768831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.769037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.769117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.773192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.773416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.773547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.773690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.773771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.773974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.774933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.775125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.775202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.775447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.793014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.793299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.793380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.793662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.797191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.797587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.800441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.800744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.800823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.801093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.804974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.805275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.808674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.809465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.811919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.812247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.812539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.812701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.812831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.813000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.813124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.813287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.813408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.813572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.813869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.814149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.829558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.829861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.830143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.830221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.830411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.830503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.830746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.831014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.837345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.837902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.838885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.839166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.839427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.839713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.841843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.842133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.842359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.842489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.842643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.842724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.842925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.843014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.843226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.843507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.854864 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.855140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.855427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.855644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.855724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.855941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.856056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.856240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.856329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.856520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.856603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.856800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.857076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.857353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.872605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.873565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.875635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.876645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.878565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.879501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.880052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.880960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.881539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.881827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.882125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.882422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.882703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.882993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.888709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.889888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.890180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.891344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.893097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.893399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.893690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.893973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.894236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.894531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.894822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.895098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.902486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.902782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.903071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.903600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.903892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.904197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.910023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.910281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.910568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.910849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 14:06:18.911112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.911947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.912987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.913117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.913264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.913353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.913525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.913646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.913809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.914056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.914334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.914594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 14:06:18.948202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5614672399c0 pid: 81597 (default app) Aug 17 14:06:18.949018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5614672399c0 pid: 81596 (default app) Aug 17 14:06:18.951619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d549-c226-4710-9726-acde5af3407f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:18.951908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d549-c226-4710-9726-acde5af3407f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:18.952212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d549-c226-4710-9726-acde5af3407f None None] PATH_INFO: `/v3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:18.956377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Wed Aug 17 14:06:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:25.489875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:25.490389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:25.490469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:25.494716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:25.499872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:25.500265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:25.500458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:25.569775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: INFO dbcounter [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] Registered counter for database keystone Aug 17 14:06:25.589785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG oslo_db.sqlalchemy.engines [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:06:25.595847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writer thread running {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:06:25.773247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG passlib.handlers.bcrypt [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81597) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 14:06:25.773672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG passlib.handlers.bcrypt [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81597) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 14:06:25.833144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:25.834767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:25.961118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 14:06:26.259206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:26.327651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: INFO dbcounter [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] Registered counter for database keystone Aug 17 14:06:26.348666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG oslo_db.sqlalchemy.engines [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:06:26.355281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writer thread running {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:06:26.476201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ec36-612d-4e36-9de2-0a491ea178cf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:26.480928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:26.481553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:26.481831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:26.482102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:26.490094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:26.552673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 14:06:26.552969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b207e0-2551-4dca-80b1-95f1fc926167 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:26.562428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Aug 17 14:06:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:06:26.568457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:26.583085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899c809-1960-440c-9c54-4df0c76f2a34 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:26.587999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:26.589147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:26.589430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:26.589702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] PATH_INFO: `/v3/projects/3648060d3e5b42e78dece5e6598cf094` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:26.591266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] RBAC: Authorizing `identity:get_project(project_id=3648060d3e5b42e78dece5e6598cf094)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:26.643434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING keystone.common.rbac_enforcer.enforcer [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 14:06:26.643782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ee0c6-c2f4-42a3-bbed-82dd0a287647 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:26.648296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Aug 17 14:06:26 2022] GET /identity/v3/projects/3648060d3e5b42e78dece5e6598cf094 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:28.499057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc900-096c-4a9c-93ca-30a7497fbefe None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:28.499579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc900-096c-4a9c-93ca-30a7497fbefe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:28.499579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc900-096c-4a9c-93ca-30a7497fbefe None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:28.503675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:28.509032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:28.509475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:28.509584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:28.529046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:28.530567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:28.538340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 14:06:28.802481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fc900-096c-4a9c-93ca-30a7497fbefe None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:28.814845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fc900-096c-4a9c-93ca-30a7497fbefe None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:28.818963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635bdc6-f34e-4788-bf7d-9047dff0a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:28.819558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bdc6-f34e-4788-bf7d-9047dff0a9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:28.819837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bdc6-f34e-4788-bf7d-9047dff0a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:28.820146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bdc6-f34e-4788-bf7d-9047dff0a9e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:28.828380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635bdc6-f34e-4788-bf7d-9047dff0a9e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:28.830144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635bdc6-f34e-4788-bf7d-9047dff0a9e8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:28.838628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Aug 17 14:06:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:06:28.843821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:28.852880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b100e7-f48d-4247-886d-cd886713e6ca None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:28.857215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd777-c070-476c-a5fe-13e8c9c0a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:28.857841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd777-c070-476c-a5fe-13e8c9c0a801 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:28.858122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd777-c070-476c-a5fe-13e8c9c0a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:28.858394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd777-c070-476c-a5fe-13e8c9c0a801 admin admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:28.859697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd777-c070-476c-a5fe-13e8c9c0a801 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:28.861561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd777-c070-476c-a5fe-13e8c9c0a801 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:28.863082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Wed Aug 17 14:06:28 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:30.803669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690364a-ed14-40ac-8328-641fd0e06ee9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:30.804233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690364a-ed14-40ac-8328-641fd0e06ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:30.804233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690364a-ed14-40ac-8328-641fd0e06ee9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:30.805618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:30.810843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:30.811241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:30.811523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:30.830224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:30.831396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:30.845642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f92d-d36a-4ee1-96e5-de0fe82a9b78 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:30.845932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f92d-d36a-4ee1-96e5-de0fe82a9b78 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:30.846214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f92d-d36a-4ee1-96e5-de0fe82a9b78 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:30.847525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:06:30.852498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:30.852787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:30.853072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:30.894469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG passlib.handlers.bcrypt [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81596) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 14:06:30.894893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG passlib.handlers.bcrypt [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81596) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 14:06:30.911160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:30.940642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:30.942234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:31.039595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:31.177964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.203197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.281988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574257f-3690-4ca8-addc-2b35924560ca None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.305826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.315636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.316311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.316599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.316876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.328777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:31.338169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:31.339189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:31.340070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:31.344988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.412153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa4dd2-c52f-432c-bf8f-e05c2547b3e5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.414410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.427010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.445442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81964d9d-9785-44b5-8702-6ef97d156059 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.452168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.453028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.453311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.453586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.479709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.480344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.480671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.480949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.481625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:31.481939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.483322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.495339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:31.500912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.520195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.522010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.597977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffad62a-0898-4388-baec-59d1459d3bb6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.617514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:06:31.623661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.626514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.635482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.636245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.636600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.636884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.638026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.639492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.641090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:31.646430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.661038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.725666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf56b1-6267-4cbb-a322-b11444c303d0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.747500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555fa6f-cd32-4bc8-bd69-c13a39aa9cfb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.761885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.762743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.763026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.763303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.781154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.782436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.782651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.783070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.783357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.783638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.784793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.786228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.787782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:31.793536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:06:31.800601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:31.801627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:06:31.802627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:06:31.802627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:06:31.802627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:31.802627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:06:31.809141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:31.864667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.873318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:31.892356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f908ff-61b6-4399-9faf-caf2996eca3e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.908143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7175c-5736-437f-96ef-0aaa3285fa76 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:31.925685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.926291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.926573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.926850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.927578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.domain.id=default, user.id=d6d936d32ad542fba7a707cd7eda404b) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:31.927966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.929417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18dee-95c9-4eff-bb09-460cb742fa36 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.936073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/role_assignments?user.id=d6d936d32ad542fba7a707cd7eda404b&scope.domain.id=default&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:31.941315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:31.941945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:31.942229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:31.942510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:31.943180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:31.943486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:31.944960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a07960-05b9-4c01-8405-b78af43fb826 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:31.966713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:33.904932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8cb4c-fcb7-42cf-b62b-2fae134ffc85 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:33.905923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8cb4c-fcb7-42cf-b62b-2fae134ffc85 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:33.906461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8cb4c-fcb7-42cf-b62b-2fae134ffc85 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:33.908357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:33.913990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23170f8b-e06d-44c6-bb59-70a45c13077b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:33.914846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23170f8b-e06d-44c6-bb59-70a45c13077b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:33.915294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23170f8b-e06d-44c6-bb59-70a45c13077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:33.944942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-23170f8b-e06d-44c6-bb59-70a45c13077b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:33.946509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23170f8b-e06d-44c6-bb59-70a45c13077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:34.037947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:34.056103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf5572-2ede-4d69-b3ed-1f2ad9a7d25f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.056391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf5572-2ede-4d69-b3ed-1f2ad9a7d25f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.056678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf5572-2ede-4d69-b3ed-1f2ad9a7d25f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.058237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:34.063539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.063830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.064149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.086200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:34.087924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:34.146576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:34.186103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:34.410342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf5572-2ede-4d69-b3ed-1f2ad9a7d25f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:34.529582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf5572-2ede-4d69-b3ed-1f2ad9a7d25f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:34.575452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:34.576497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.576969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.577427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.592865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:34.597883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:34.598692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:34.599423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:34.602549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 14/26] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:34.613080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:34.660306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:34.676378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:34.819631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa095c2-2042-4aa7-947b-88924d906278 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:34.849960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890040c-1ad2-4aa1-be7b-d90e4dcbb155 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:34.885264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:34.886362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.887215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.887928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.888853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:34.889495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:34.891876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd99f-48ac-4d5d-9980-d36b6d502450 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:34.899586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:34.900514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.900941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.901380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.906774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 13/27] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:34.912677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c178d-240d-43df-887e-6844c7fbc875 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.912677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c178d-240d-43df-887e-6844c7fbc875 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.912999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c178d-240d-43df-887e-6844c7fbc875 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.916616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:34.917703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003a0f-0193-4fc6-bada-8c95faa4e256 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.918166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003a0f-0193-4fc6-bada-8c95faa4e256 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.918596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003a0f-0193-4fc6-bada-8c95faa4e256 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.918996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:34.920682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:34.920801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:34.921496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003a0f-0193-4fc6-bada-8c95faa4e256 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-81fdfdd7-f360-4572-a3dc-a96ee728a4d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:06:34.940225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:34.941247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:06:34.942225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:06:34.942225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:06:34.942225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:34.944573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:34.945940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5d785-28b2-4051-9c33-e46ad8bc4ec4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:34.946362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5d785-28b2-4051-9c33-e46ad8bc4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:34.947018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5d785-28b2-4051-9c33-e46ad8bc4ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:34.969470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-21a5d785-28b2-4051-9c33-e46ad8bc4ec4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:34.971681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-21a5d785-28b2-4051-9c33-e46ad8bc4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:34.975464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:35.034283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:35.051474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003a0f-0193-4fc6-bada-8c95faa4e256 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:35.053384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:35.055052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.055565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.056090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.076245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:35.077870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:35.091688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:35.092430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.092760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.093030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.095347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:35.097522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:35.099798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:34 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:35.106028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:35.170656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 17/33] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:35.171825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:35.279785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965132-c824-4a50-9bb0-79eea3ecdfd6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:35.292987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:35.348283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:35.349287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.349771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.350242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.351089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:35.351607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:35.356823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:35.377266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 17/34] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:35.379429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c8483-4a07-4514-b25d-310656c4ef22 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:35.382648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:35.420192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:35.454849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:35.456136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.458933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.459417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.460971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:35.464967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:35.466981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 18/35] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:35.469756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:35.580406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2fd6-dfc2-4424-9ae5-8476396b3e1d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:35.643508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:35.645416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.649325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.650783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.651851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:35.653750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:35.663526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739cd0-9cd0-4a57-8d86-7a7bef7149fe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:35.705833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:35.706491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.706777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.707052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.707776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:35.709386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:35.809392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:06:35 2022] POST /identity/v3/projects => generated 301 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:06:35.810356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:35.833730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:35.835437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Aug 17 14:06:35 2022] POST /identity/v3/roles => generated 219 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:35.835437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:35.943407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6c1a-9be0-4c62-9bac-4aad290a90ea None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:35.993434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beafbb-e4b5-4e97-9431-d3db0b538603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:35.994145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beafbb-e4b5-4e97-9431-d3db0b538603 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:35.994431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beafbb-e4b5-4e97-9431-d3db0b538603 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:35.994711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beafbb-e4b5-4e97-9431-d3db0b538603 None admin] PATH_INFO: `/v3/domains/default/users/d6d936d32ad542fba7a707cd7eda404b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:35.997702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beafbb-e4b5-4e97-9431-d3db0b538603 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d6d936d32ad542fba7a707cd7eda404b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:35.999700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beafbb-e4b5-4e97-9431-d3db0b538603 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:36.015738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:36.026056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1361 bytes} [Wed Aug 17 14:06:35 2022] PUT /identity/v3/domains/default/users/d6d936d32ad542fba7a707cd7eda404b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:06:36.027470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f02d5a-0e03-46cb-85f7-6c70ac6056d6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.027761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f02d5a-0e03-46cb-85f7-6c70ac6056d6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.032154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f02d5a-0e03-46cb-85f7-6c70ac6056d6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.034333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 20/39] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:36.035456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b25cb-13ca-4eb0-8317-9f3ea06c775e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.035746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b25cb-13ca-4eb0-8317-9f3ea06c775e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.036119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b25cb-13ca-4eb0-8317-9f3ea06c775e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.039178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 21/40] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:36.044554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.044944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.045568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.067727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:36.069457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:36.098578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11614e-8462-4f26-a170-dd59e4d49d0f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:36.144613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeee0fc-574b-4f0c-8905-94c0c06847cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:36.145263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeee0fc-574b-4f0c-8905-94c0c06847cd None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.145546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeee0fc-574b-4f0c-8905-94c0c06847cd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.145822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeee0fc-574b-4f0c-8905-94c0c06847cd None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.146509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeee0fc-574b-4f0c-8905-94c0c06847cd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:36.148101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeee0fc-574b-4f0c-8905-94c0c06847cd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:36.164000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Aug 17 14:06:35 2022] POST /identity/v3/roles => generated 225 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:36.169712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:36.173779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.174369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.174861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.198191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:36.200128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:36.289208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:36.455862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:36.466903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:36.558116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:36.562949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516901e-1edc-403e-9339-e68a0ed1b21a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:36.591806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:36.600667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:36.601520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.602092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.602447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.603657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:36.605220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:36.607033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 23/44] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:36.612242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:36.664105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805fd35-43ad-4d4c-ba8b-8f36c1121e25 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:36.693552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:36.701515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215a62-9af8-426f-a16e-0927803e615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:36.702135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215a62-9af8-426f-a16e-0927803e615f None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.702412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215a62-9af8-426f-a16e-0927803e615f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.702683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215a62-9af8-426f-a16e-0927803e615f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.703353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215a62-9af8-426f-a16e-0927803e615f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:36.704781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215a62-9af8-426f-a16e-0927803e615f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:36.720703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618e9c4-def5-459b-ab76-132bc5d5d36e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:36.721702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Aug 17 14:06:36 2022] POST /identity/v3/roles => generated 223 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:06:36.764624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0adf3-a635-4779-8062-e6f6cedd4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:36.765261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0adf3-a635-4779-8062-e6f6cedd4795 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:36.765547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0adf3-a635-4779-8062-e6f6cedd4795 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:36.765888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0adf3-a635-4779-8062-e6f6cedd4795 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:36.766667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0adf3-a635-4779-8062-e6f6cedd4795 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:36.768226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0adf3-a635-4779-8062-e6f6cedd4795 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:36.807983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:06:36 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:06:38.008169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94024a-a572-4a41-9a1f-883339e1a28e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.008649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94024a-a572-4a41-9a1f-883339e1a28e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.008649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94024a-a572-4a41-9a1f-883339e1a28e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.009971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:38.015131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.015564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.015695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.034426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:38.035602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:38.100179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:38.364267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94024a-a572-4a41-9a1f-883339e1a28e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:38.458055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:38.466633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94024a-a572-4a41-9a1f-883339e1a28e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:38.500785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:38.501422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.501707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.501984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.512373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:38.517099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:38.517918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:38.518717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:38.525073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:38.580755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:38.624560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9b14b-0143-41ee-b6ba-45b7d0ee6db7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:38.656929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:38.657541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.657827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.658101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.658766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:38.659071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:38.660493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e66b3-4477-40ef-8ae5-07866ac22c52 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:38.668906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 26/50] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:38.674710 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:38.704713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540283cc-c9de-49eb-af04-cbec4eb12221 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.705000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540283cc-c9de-49eb-af04-cbec4eb12221 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.705275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540283cc-c9de-49eb-af04-cbec4eb12221 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.706620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 27/51] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:06:38.712015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.712306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.712582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.730354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:38.731562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:38.776312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764f5c-4b31-40ea-a64b-ffb4ad0c5fba None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:38.797555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 28/52] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:38.809358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:38.809988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:38.810271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:38.810547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:38.811687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:38.813171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:38.814726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 25/53] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:38 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:38.820784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:38.869682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:38.917727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0810f0-b366-40ae-840b-d5cc7c6fd8c8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:39.053296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:39.053956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:39.054194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:39.054475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:39.055622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:39.057094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:39.058650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 29/54] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:39.064462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:39.065283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:39.090185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:39.164861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9ebe-c28c-49ff-ba02-45cb69727b4a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:39.165083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d272d-ecd5-43c5-a35c-a3036bac8212 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:39.182065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:39.199191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:39.199708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:39.199826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:39.200105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:39.200377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:39.200474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:39.200662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:39.200939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:39.201105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.domain.id=default, user.id=d6d936d32ad542fba7a707cd7eda404b) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:39.201420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:39.202051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:39.202871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf995a-4cbe-4725-b069-ef8a126d6fb7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:39.203493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:39.205102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 30/55] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:39.219999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 26/56] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Aug 17 14:06:39 2022] GET /identity/v3/role_assignments?user.id=d6d936d32ad542fba7a707cd7eda404b&scope.domain.id=default&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:39.220210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:39.314603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8337b-d2cc-4f11-906e-15bba6d1411c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:39.350245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61bc9e-88ef-40c6-a92d-beb6898155ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:39.350245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61bc9e-88ef-40c6-a92d-beb6898155ba None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:39.350538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61bc9e-88ef-40c6-a92d-beb6898155ba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:39.351445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61bc9e-88ef-40c6-a92d-beb6898155ba None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:39.351445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61bc9e-88ef-40c6-a92d-beb6898155ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:39.353469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61bc9e-88ef-40c6-a92d-beb6898155ba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:39.379567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 31/57] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Aug 17 14:06:39 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:41.262294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab9cee-59aa-4fe5-91fd-e6e49f2f9511 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:41.262812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab9cee-59aa-4fe5-91fd-e6e49f2f9511 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:41.262896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab9cee-59aa-4fe5-91fd-e6e49f2f9511 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:41.264234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 27/58] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:41.269228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:41.269621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:41.269798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:41.287263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:41.288503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:41.317530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:41.353866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 32/59] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:41.625295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab9cee-59aa-4fe5-91fd-e6e49f2f9511 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:41.716349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:41.731940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab9cee-59aa-4fe5-91fd-e6e49f2f9511 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:41.765955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab865e5e-148f-476b-b7b1-3c03222051d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:41.766576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865e5e-148f-476b-b7b1-3c03222051d1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:41.766856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865e5e-148f-476b-b7b1-3c03222051d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:41.767129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab865e5e-148f-476b-b7b1-3c03222051d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:41.768264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab865e5e-148f-476b-b7b1-3c03222051d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:41.769690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab865e5e-148f-476b-b7b1-3c03222051d1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:41.771234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 28/60] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:41.776743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:41.872651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613a8b-f22d-4e99-ad91-a264c5c29aba None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:41.904762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4ae8-b820-4bdc-ab31-263e77e2a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:41.905314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4ae8-b820-4bdc-ab31-263e77e2a393 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:41.905596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4ae8-b820-4bdc-ab31-263e77e2a393 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:41.905873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4ae8-b820-4bdc-ab31-263e77e2a393 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:41.906520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4ae8-b820-4bdc-ab31-263e77e2a393 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:41.907992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4ae8-b820-4bdc-ab31-263e77e2a393 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:41.933379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 33/61] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:06:41 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:44.886423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3be2d-2e11-4e7e-bbf0-fe1dee7b5336 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:44.887405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3be2d-2e11-4e7e-bbf0-fe1dee7b5336 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:44.887878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3be2d-2e11-4e7e-bbf0-fe1dee7b5336 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:44.889470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 29/62] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:44.894821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa878496-9e19-4547-a185-0f5ed5922535 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:44.895589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa878496-9e19-4547-a185-0f5ed5922535 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:44.896106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa878496-9e19-4547-a185-0f5ed5922535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:44.924048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa878496-9e19-4547-a185-0f5ed5922535 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:44.925575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa878496-9e19-4547-a185-0f5ed5922535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:44.952556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:45.019309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 34/63] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:45.059715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eea59-bf9a-460c-aa41-b525a111266f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.060374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eea59-bf9a-460c-aa41-b525a111266f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.060843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eea59-bf9a-460c-aa41-b525a111266f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.062373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 30/64] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:45.067509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74e1c6-ec9f-4a89-bd35-9ec2632168e7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.068036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74e1c6-ec9f-4a89-bd35-9ec2632168e7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.068530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74e1c6-ec9f-4a89-bd35-9ec2632168e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.091918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ee74e1c6-ec9f-4a89-bd35-9ec2632168e7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:45.093422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ee74e1c6-ec9f-4a89-bd35-9ec2632168e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:45.123472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009bc28-3286-46d1-a879-4ae749a21a29 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.124124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009bc28-3286-46d1-a879-4ae749a21a29 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.124625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009bc28-3286-46d1-a879-4ae749a21a29 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.126718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 31/65] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:45.131814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc564-af50-4285-b8c8-0159cc991378 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.133011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc564-af50-4285-b8c8-0159cc991378 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.133492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc564-af50-4285-b8c8-0159cc991378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.169792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 35/66] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:45.174387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-293bc564-af50-4285-b8c8-0159cc991378 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:45.175727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-293bc564-af50-4285-b8c8-0159cc991378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:45.285634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 32/67] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:45.380713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83618d-8719-4e1b-8a08-486aa81d68a1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.381331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83618d-8719-4e1b-8a08-486aa81d68a1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.381821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83618d-8719-4e1b-8a08-486aa81d68a1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.383638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 36/68] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:45.389118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.389622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.390099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.417642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:45.419511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:45.431086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83618d-8719-4e1b-8a08-486aa81d68a1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:45.495427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 33/69] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:45.496542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:45.524553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:45.559050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:45.612392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83618d-8719-4e1b-8a08-486aa81d68a1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:45.644058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5e464-bd63-4215-9ad3-bf2e037420d9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:45.656966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:45.657609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.657889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.658166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.671131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:45.677669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:45.678711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 37/70] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:45.679672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:45.692274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:45.693048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.693448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.693819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.705424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:45.710266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:45.711186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:45.713129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:45.791108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:45.794582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bda78-6614-4352-a765-05a622883328 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:45.818873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04800c-7320-42ff-8f70-c37ad4c64879 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:45.831759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:45.832425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.832706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.832984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.843584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:45.848630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:45.849645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:45.850446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:45.855089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:45.855702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.856012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.856289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.856501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:45.856953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:45.857257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:45.858876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990e27b-66f1-46a7-960e-cd8026667123 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:45.868013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:45.869249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f55c05-c0a3-42ca-9aea-be553e113c3b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.869701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f55c05-c0a3-42ca-9aea-be553e113c3b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.869826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f55c05-c0a3-42ca-9aea-be553e113c3b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.871159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 36/74] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:45.871729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f55c05-c0a3-42ca-9aea-be553e113c3b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:45.952075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a912-9641-4a3d-a0ee-9cd30bca243e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:45.972482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f55c05-c0a3-42ca-9aea-be553e113c3b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:45.986943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:45.987537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:45.987816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:45.988119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:45.988808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:45.989115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:45.990502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:45.998311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 39/75] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:45.999079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.006161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c0488-afe2-4564-b3b0-5d0132e149b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.006792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0488-afe2-4564-b3b0-5d0132e149b0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.007075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0488-afe2-4564-b3b0-5d0132e149b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.007396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0488-afe2-4564-b3b0-5d0132e149b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.010029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.018297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c0488-afe2-4564-b3b0-5d0132e149b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0c9c0488-afe2-4564-b3b0-5d0132e149b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:46.023506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:46.024371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:46.025095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 37/76] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:46.026202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.026358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.026836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.044356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:46.045538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:46.066288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.099803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf4e8-c311-4d06-9467-149100e62372 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.111981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 38/77] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:46.112826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.139664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.140303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.140586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.140857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.141514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:46.142101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.143199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.151391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 40/78] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.152217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.222378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2078e6-c0cf-44a9-8152-02d9a7c4fcc5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.249769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.258368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64a1e1-336d-4a0a-a139-b44edcfc055e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.258840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.259483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.259773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.260076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.274048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.275563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.277248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 39/79] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.278026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.289979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.299156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.299801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.300130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.300412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.301562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.303013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.309139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.309139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.390598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8696b-60fd-49e5-9e4d-a0c9200655f9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.410525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3841ab-da11-44c3-8819-39569e5bb166 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.423894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.424533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.424814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.425088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.425750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:46.426057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.427432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.435882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.436766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.446082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.447322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.447624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.447908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.449397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.450859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.456795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.456795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.485998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.514501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.538914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc79ffd-7f19-4da9-a895-8cc039bd5eda None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.552161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b3af-be6a-4174-8b01-05abb900f058 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.572065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.572669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.572953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.573226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.585210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.586176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.586464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.586747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.639445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.641000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.654634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.656135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.685150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.715610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.744465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:06:46.745131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.757654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:06:46.758520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.843797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516dd6-ac4a-4dc9-943b-6fbe66bbdbc0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.854842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a06a-17a5-4b23-b200-131fc5a2d568 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.879735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.880402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.880682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.880953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.882146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.883647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.885382 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 42/85] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.885987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.888115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:46.888856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:46.889136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:46.889408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:46.890877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:46.892391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:46.898845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 44/86] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:46.898845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:46.906580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.925233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:46.990326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bf55-73cb-4a8c-b334-324f166f3d34 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:46.993359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ddff-a13a-4b2c-898a-b49801c55600 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.023574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.024202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.024485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.024759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.026718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.027342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.027627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.027905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.029056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.030505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.032328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 45/87] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:47.032907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.096241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.097872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.112489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.126605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.129749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39881e26-047f-4eec-be0f-04893a1b3d47 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.165230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.165973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.166352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.166702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.167922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.169397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.171021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 46/88] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:47.175891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.198471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 43/89] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:06:47.199511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.267893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259efbb5-868b-4841-8439-bb23df991489 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.299103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdcbe8-0445-4b64-95e1-99c869c27b30 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.300518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.301123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.301408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.301683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.302326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.303763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.312716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.326616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 47/90] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:06:47 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:47.326616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.345692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.346200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.346481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.346760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.356664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.425641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.427207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.440911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047f78-84a6-49e1-9592-cd3901ac2875 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.479845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.480488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.480768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.481481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.481787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=dd10d0d387e344a28f352cb08913b6b6) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:47.482104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.483569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.492865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 48/91] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/role_assignments?user.id=dd10d0d387e344a28f352cb08913b6b6&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:47.493673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.556370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 44/92] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:06:47.557269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.582499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.614883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.631634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830dc6a-9ef9-49a6-8ed8-47e4bca25141 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.682602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.683138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.683423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.683702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.684485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] RBAC: Adding query filter params (role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=dd10d0d387e344a28f352cb08913b6b6) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:47.684805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.686349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.692679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/role_assignments?user.id=dd10d0d387e344a28f352cb08913b6b6&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:47.693496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.707011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4e5b-e001-449e-a3ca-65b02b81fa75 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.764471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.765149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.765444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.766147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.767408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.768949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.771903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:47.778321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.836875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4312-8eef-4f94-8bb6-a005a5228949 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.880469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:47.885251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.885950 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.886246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.886528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] PATH_INFO: `/v3/projects/934469f842324ebe99071f1fffcdba12` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.887775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] RBAC: Authorizing `identity:get_project(project_id=934469f842324ebe99071f1fffcdba12)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.889453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.891440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 50/95] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/projects/934469f842324ebe99071f1fffcdba12 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:47.894670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13b72a-dfa3-4199-9272-46f24cedda9c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:47.910204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:47.941467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:47.942846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:47.943358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:47.943978 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:47.945521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=d6d936d32ad542fba7a707cd7eda404b) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:47.945999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:47.948210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be52c-556b-4586-8fbe-e3a0d8088059 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:47.955585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/role_assignments?user.id=d6d936d32ad542fba7a707cd7eda404b&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:47.968378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:48.085905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce041ae-1f4f-4262-bf5e-a54476001c7a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:48.129255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:48.129894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:48.130182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:48.130461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:48.131217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=934469f842324ebe99071f1fffcdba12, user.id=dd10d0d387e344a28f352cb08913b6b6) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:48.131532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:48.133591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e2e82-211e-4c46-9c68-f64a8aae53b5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:48.144993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:47 2022] GET /identity/v3/role_assignments?user.id=dd10d0d387e344a28f352cb08913b6b6&scope.project.id=934469f842324ebe99071f1fffcdba12&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:49.842770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bd80-c5e9-40db-b542-2611f008c56d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:49.843760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bd80-c5e9-40db-b542-2611f008c56d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:49.844309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bd80-c5e9-40db-b542-2611f008c56d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:49.845882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:49.851161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3371-ebc4-49c6-9650-f26052449074 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:49.851986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3371-ebc4-49c6-9650-f26052449074 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:49.852489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3371-ebc4-49c6-9650-f26052449074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:49.876257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-381c3371-ebc4-49c6-9650-f26052449074 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:49.877774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-381c3371-ebc4-49c6-9650-f26052449074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:49.970326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:50.066948 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9a188-3695-4469-931b-bf468198a104 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.067600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9a188-3695-4469-931b-bf468198a104 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.068123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9a188-3695-4469-931b-bf468198a104 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.070277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 48/100] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:50.076394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88161f95-894c-4f16-8026-582dc896d9aa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.076678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88161f95-894c-4f16-8026-582dc896d9aa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.076966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88161f95-894c-4f16-8026-582dc896d9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.103444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-88161f95-894c-4f16-8026-582dc896d9aa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:50.104810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88161f95-894c-4f16-8026-582dc896d9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:50.115538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:50.191382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 53/101] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:50.423287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9a188-3695-4469-931b-bf468198a104 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:50.502715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b6f9-5383-4a58-80f0-a6b270181d66 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.503024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b6f9-5383-4a58-80f0-a6b270181d66 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.503291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b6f9-5383-4a58-80f0-a6b270181d66 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.504689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 54/102] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:50.510690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28925c64-6cb2-4d60-a360-dcbf326c9a43 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.510987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28925c64-6cb2-4d60-a360-dcbf326c9a43 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.511267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28925c64-6cb2-4d60-a360-dcbf326c9a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.540586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-28925c64-6cb2-4d60-a360-dcbf326c9a43 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:50.542202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-28925c64-6cb2-4d60-a360-dcbf326c9a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:50.559392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9a188-3695-4469-931b-bf468198a104 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:50.596097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb110c5-0538-4ffa-bfee-1649d369257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:50.596738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb110c5-0538-4ffa-bfee-1649d369257d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.597027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb110c5-0538-4ffa-bfee-1649d369257d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.597308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb110c5-0538-4ffa-bfee-1649d369257d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.598433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb110c5-0538-4ffa-bfee-1649d369257d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:50.599905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb110c5-0538-4ffa-bfee-1649d369257d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:50.607388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 49/103] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:50.607388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956a3ee-3c88-4746-8168-29edf27cc085 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.607388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956a3ee-3c88-4746-8168-29edf27cc085 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.607388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956a3ee-3c88-4746-8168-29edf27cc085 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.607388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 50/104] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:50.608773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956a3ee-3c88-4746-8168-29edf27cc085 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:50.628157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:50.646462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 55/105] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:50.648727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d372de-018e-414b-9216-2c4a28555464 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.649321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d372de-018e-414b-9216-2c4a28555464 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.649842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d372de-018e-414b-9216-2c4a28555464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.668759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-79d372de-018e-414b-9216-2c4a28555464 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:50.670248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-79d372de-018e-414b-9216-2c4a28555464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:50.773538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 56/106] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:50.774397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d372de-018e-414b-9216-2c4a28555464 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:50.781155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:50.820822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956a3ee-3c88-4746-8168-29edf27cc085 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:50.885165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:50.885814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:50.886059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:50.886336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:50.886982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:50.888464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:50.942024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 51/107] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:06:50 2022] POST /identity/v3/projects => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:50.962087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d372de-018e-414b-9216-2c4a28555464 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.001233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.032851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.036786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.037081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.037363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.063061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:51.073664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:51.074585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:51.075319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 57/108] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:51.081748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.153527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:51.212672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93c2f-3d56-48cf-af52-717c174ce897 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.226466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:51.264361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.264939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.265225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.265500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.270332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501c9ca-5599-476c-b490-50a64207c5e6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.277106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:51.282705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:51.283535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:51.284353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 52/109] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:51.284957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.307928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.308574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.308857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.309231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.309903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:51.310208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:51.311705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:51.322138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 58/110] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:51.322944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.398376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef602244-610f-4550-b849-86fc8e8d7939 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.425609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:51.430442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7facc61-793a-4a28-87d4-9fcd552dd504 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.436188 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.436932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.437291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.437583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.449908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:51.454739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:51.455556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:51.456344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 53/111] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:51.456939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.459748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:51.470444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.471062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.471390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.471671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.472386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:51.472698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:51.474110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d3e7c-3da7-47c6-a3a7-07d1f1e077fb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:51.483755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 59/112] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:51.484977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11956d83-ef6f-408a-81af-6546e081aced None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.485268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11956d83-ef6f-408a-81af-6546e081aced None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.485549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11956d83-ef6f-408a-81af-6546e081aced None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.487316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 60/113] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:51.488702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cbb0c-6423-4b85-ba29-84d325a2e25c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.488971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cbb0c-6423-4b85-ba29-84d325a2e25c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.489251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cbb0c-6423-4b85-ba29-84d325a2e25c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.490627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 61/114] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:51.493207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cbb0c-6423-4b85-ba29-84d325a2e25c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.579215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b58b5-3233-4eb8-9057-5302a72cc440 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.603912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cbb0c-6423-4b85-ba29-84d325a2e25c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.614347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.614973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.615257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.615538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] PATH_INFO: `/v3/users/f2cd18b2e8434ff589989b4a949311e1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.629974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd18b2e8434ff589989b4a949311e1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:51.631471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:51.634071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 54/115] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/users/f2cd18b2e8434ff589989b4a949311e1 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:51.634826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.643376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.644143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.644496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.644844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.646023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:51.646333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:51.648268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d638d85-81b5-46fc-9e03-cf4311d74924 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:51.657132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 62/116] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:51.658182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc657-2951-48c1-83bb-3afe6ddb8c64 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.660004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc657-2951-48c1-83bb-3afe6ddb8c64 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.660004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc657-2951-48c1-83bb-3afe6ddb8c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.679319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-223cc657-2951-48c1-83bb-3afe6ddb8c64 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:51.680522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-223cc657-2951-48c1-83bb-3afe6ddb8c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:51.689931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:51.734341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:51.752954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48882-842c-428f-9baa-4b01ec521715 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.756638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 63/117] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:51.758592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.759035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.759431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.778843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:51.780225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:51.795810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:51.796622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:51.797106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:51.797480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:51.798747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:51.800341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:51.807989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 55/118] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:51.809114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.864009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 64/119] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:51.865562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:51.956286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e8432-10c2-4bdb-8a48-2df20dcf3338 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:51.981364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.027610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.028348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.028632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.029004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.038014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5070e-f368-4662-9d60-0a317e704436 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.049821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.075239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.076064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.076452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.076831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.078072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.079634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.081549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 65/120] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:52.082248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.135688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.137921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.200305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50ca5-45d8-49e2-a074-fdd610599c68 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.236720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.237359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.237639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.237913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.239026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.240628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.247663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 66/121] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:52.247663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.261600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 56/122] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:06:52.261600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.273031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.300944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.358972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f877dab-1ea3-4721-8615-c33ae1b0399f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.359941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a61dc-8807-4985-80f4-65b9be3bf2c9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.395398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.395981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.396280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.396564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.398790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.399418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.399703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.399996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.401133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.402583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.404415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 57/123] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:52.404981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.411422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:52.416742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:52.417583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:52.418328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 67/124] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:52.418944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.508764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.528006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e79adb-b488-4c4b-9c3d-f448f3972711 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.531250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d11397-26c1-4f1b-a65e-d11bdaae8be4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.535635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.563366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.564077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.564367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.564652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/dd10d0d387e344a28f352cb08913b6b6/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.565245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.565880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.566164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.566440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.566726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e7bf2b50344d62823af7a10bf55d7b, user_id=dd10d0d387e344a28f352cb08913b6b6, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.568231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.578914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:52.583868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:52.584752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:52.586096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:52.586675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 68/125] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:06:52 2022] PUT /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/dd10d0d387e344a28f352cb08913b6b6/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:06:52.586741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 58/126] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:52.586802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.586871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.721862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3517-f00f-4563-90de-fdd1184947a6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.732536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b5ef-ea71-49ec-b7b2-dc99ba693ee8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.782382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.783036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.783323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.783601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.784766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.786233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.786507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.787357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.787805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.787949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 69/127] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:52.788484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/dd10d0d387e344a28f352cb08913b6b6/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.788908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.791264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=53e7bf2b50344d62823af7a10bf55d7b, user_id=dd10d0d387e344a28f352cb08913b6b6, role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.793301 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.808927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.816601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 59/128] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:06:52 2022] PUT /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/dd10d0d387e344a28f352cb08913b6b6/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:06:52.818237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.829867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:52.909115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edebf86-72cb-4b65-863f-d7fa34b2dec1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.936277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5482d-cbbb-4a54-9d2f-e503f2ff7f3b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:52.949238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.950105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.950495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.950892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.951675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:52.952138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.953665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.964156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 70/129] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:52.965135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:52.975751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:52.976977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:52.977529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:52.977975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:52.978853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:52.979354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:52.981020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:52.990984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 60/130] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:52.993002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:53.063336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:53.103618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c7387-6614-4b93-a92e-e3648c3e470c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.106026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:53.108143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b4f6-21c0-4284-b448-3f2646d53986 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.146175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.147362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.147948 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.148490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.150031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.150284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.150976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.151357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.151710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.152457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.152574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] RBAC: Adding query filter params (role.id=a311497495e6415e8042a23071507fe4, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=f2cd18b2e8434ff589989b4a949311e1) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:53.152955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.154607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.155058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 61/131] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:53.156131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:53.162196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 71/132] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:52 2022] GET /identity/v3/role_assignments?user.id=f2cd18b2e8434ff589989b4a949311e1&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=a311497495e6415e8042a23071507fe4 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:53.163025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:53.357561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a67bc-c0fb-41f5-be73-97a31be9bb1f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.367157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bd7aa-72e9-4285-9bee-ad8d0e5455c9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.392852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:53.398271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd642eaf-dbd9-4fdf-8e15-7bdb06bf4b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.398971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd642eaf-dbd9-4fdf-8e15-7bdb06bf4b57 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.399399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd642eaf-dbd9-4fdf-8e15-7bdb06bf4b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.399714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd642eaf-dbd9-4fdf-8e15-7bdb06bf4b57 None admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.401030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd642eaf-dbd9-4fdf-8e15-7bdb06bf4b57 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.402993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd642eaf-dbd9-4fdf-8e15-7bdb06bf4b57 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.403731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a3dd-1379-42db-9f49-3f6c1f14ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.404560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a3dd-1379-42db-9f49-3f6c1f14ca31 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.404943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 62/133] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:53 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:53.405182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a3dd-1379-42db-9f49-3f6c1f14ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.405616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a3dd-1379-42db-9f49-3f6c1f14ca31 None admin] PATH_INFO: `/v3/projects/934469f842324ebe99071f1fffcdba12` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.406554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21529e-adfe-4d2e-b9ec-e33d41840742 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.406933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21529e-adfe-4d2e-b9ec-e33d41840742 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.407237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a3dd-1379-42db-9f49-3f6c1f14ca31 None admin] RBAC: Authorizing `identity:get_project(project_id=934469f842324ebe99071f1fffcdba12)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.407341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21529e-adfe-4d2e-b9ec-e33d41840742 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.408935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 63/134] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:53.409138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a3dd-1379-42db-9f49-3f6c1f14ca31 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.411284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 72/135] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:53 2022] GET /identity/v3/projects/934469f842324ebe99071f1fffcdba12 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:53.415606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21529e-adfe-4d2e-b9ec-e33d41840742 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:53.417044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.417498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.417927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.455261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:53.457392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:53.500610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:53.575629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21529e-adfe-4d2e-b9ec-e33d41840742 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.582166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 73/136] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:53.583263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:53.649875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.650697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.650983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.652167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.653317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.654837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.656524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 64/137] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:53 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:53.662665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:53.787456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:53.801947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7de40-5232-4aad-bdf8-4a98b31dd5c8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.849663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649131c-b7f4-47ea-b03f-8e077dbd4b78 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:53.859864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.860579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.860862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.861139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] PATH_INFO: `/v3/projects/934469f842324ebe99071f1fffcdba12/users/dd10d0d387e344a28f352cb08913b6b6/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.864842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=934469f842324ebe99071f1fffcdba12, user_id=dd10d0d387e344a28f352cb08913b6b6, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.866371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.889638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 74/138] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:06:53 2022] PUT /identity/v3/projects/934469f842324ebe99071f1fffcdba12/users/dd10d0d387e344a28f352cb08913b6b6/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:06:53.896554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:53.897345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:53.898193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:53.898531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/d6d936d32ad542fba7a707cd7eda404b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:53.902575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e7bf2b50344d62823af7a10bf55d7b, user_id=d6d936d32ad542fba7a707cd7eda404b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:53.904048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:53.923105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 65/139] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:06:53 2022] PUT /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/d6d936d32ad542fba7a707cd7eda404b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:06:54.029834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:54.052066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:54.144193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4b40e-3ade-497a-a720-8cbb1a47c0d0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:54.181279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a13e92-e7af-4712-a2d9-01008874abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:54.181848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13e92-e7af-4712-a2d9-01008874abbd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:54.182130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13e92-e7af-4712-a2d9-01008874abbd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:54.182403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13e92-e7af-4712-a2d9-01008874abbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:54.183520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13e92-e7af-4712-a2d9-01008874abbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:54.185056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13e92-e7af-4712-a2d9-01008874abbd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:54.186635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 75/140] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:54.192304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:54.332530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d9eac-ffd1-4f6d-9658-6d2452c89d19 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:54.367150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:54.376844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3790e7-14d2-498b-853a-c474ea6a0287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:54.377655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3790e7-14d2-498b-853a-c474ea6a0287 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:54.378163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3790e7-14d2-498b-853a-c474ea6a0287 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:54.378453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3790e7-14d2-498b-853a-c474ea6a0287 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:54.379110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3790e7-14d2-498b-853a-c474ea6a0287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:54.380608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3790e7-14d2-498b-853a-c474ea6a0287 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:54.416657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 66/141] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:06:54 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:06:55.016430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516141a6-7bd2-4e91-8294-2f52b2c6426e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:55.016776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516141a6-7bd2-4e91-8294-2f52b2c6426e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:55.016965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516141a6-7bd2-4e91-8294-2f52b2c6426e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:55.018466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 76/142] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:55.023696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b6c0-029b-4b09-8873-5248d814bc66 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:55.024241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b6c0-029b-4b09-8873-5248d814bc66 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:55.024723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b6c0-029b-4b09-8873-5248d814bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:55.049018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e2d6b6c0-029b-4b09-8873-5248d814bc66 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:55.050532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e2d6b6c0-029b-4b09-8873-5248d814bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:55.133836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 67/143] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:55.316642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedb3b-8ecb-4242-891c-15d6ed476e8e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:55.317107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedb3b-8ecb-4242-891c-15d6ed476e8e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:55.317107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedb3b-8ecb-4242-891c-15d6ed476e8e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:55.318452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 77/144] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:55.329574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:55.330497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:55.331006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:55.361081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:55.362617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:55.434055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 68/145] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:55.510739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eedb3b-8ecb-4242-891c-15d6ed476e8e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:55.623510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:55.644255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eedb3b-8ecb-4242-891c-15d6ed476e8e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:55.687297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:55.687971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:55.688258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:55.688533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:55.706036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:55.711431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:55.712274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:55.713026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 78/146] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:55.719711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:55.795845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:55.869741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19fb7-ce65-416b-ade3-c09d61979465 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:55.917093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:55.917635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:55.917919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:55.918194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:55.918872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:55.919186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:55.920614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:55.933023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 69/147] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:55.938506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.064705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f9dd-f190-4d40-9e66-d592419268ad None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:56.092440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.106832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:56.107576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.107856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.108173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.110692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:56.112214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:56.114155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 79/148] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:55 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:56.120548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.146337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:56.279344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbc973-5c05-4dee-b0a3-5e54146f16b0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:56.282196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:56.317955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972446a-47ee-4597-9b60-a79d1c455fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:56.319650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972446a-47ee-4597-9b60-a79d1c455fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.320160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972446a-47ee-4597-9b60-a79d1c455fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.320738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972446a-47ee-4597-9b60-a79d1c455fa7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.336615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00303f7d-a6db-4a05-8bd9-a42305016fc5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:56.338554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972446a-47ee-4597-9b60-a79d1c455fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5972446a-47ee-4597-9b60-a79d1c455fa7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:56.344318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:56.345109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:06:56.345841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:56.352707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 70/149] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:06:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:56.354316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4b46-eb7c-44f0-8dba-06cc42fe9eef None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.354795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4b46-eb7c-44f0-8dba-06cc42fe9eef None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.355263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4b46-eb7c-44f0-8dba-06cc42fe9eef None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.356855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 71/150] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:56.362332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.362850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.363326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.392411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:56.394073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:56.405299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:56.405930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.406219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.406484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.471139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 72/151] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:56.472549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.513958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:56.515492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:56.545141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:56.578619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:56.588264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec9027-552e-4017-960c-9c01d204d86f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:56.625980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:56.626938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.627409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.627868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.628769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:56.629289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:56.630975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:56.640363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 73/152] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:06:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:56.646379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.743164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 80/153] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:06:56.748725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.757823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec38bf0-e355-40c4-be91-430d4f64ce20 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:56.795254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:56.796252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.796745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.797207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.798538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:56.800204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:56.802503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 74/154] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:56 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:56.807776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:56.841679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:56.943021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f0085-3795-48df-beb1-84150e997f1e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:56.983140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:56.984122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:56.984623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:56.985087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:56.995697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f525ad-8923-488f-ac65-13b5e43cf99b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.033084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:57.062372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.064184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.091483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:57.099329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.099991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.100821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.101079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.102389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.104025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.105817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 81/155] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:56 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:57.106739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:57.179275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 75/156] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:06:57.180152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:57.287020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f78bd-6eba-4280-b72f-456341587c32 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.312726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:57.326333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.327169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.327616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.328047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.329014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=dd10d0d387e344a28f352cb08913b6b6) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:57.329459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.331170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.338405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 76/157] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/role_assignments?user.id=dd10d0d387e344a28f352cb08913b6b6&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:57.339440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:57.339987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a3d4-e623-485a-bbbb-f4c97f9542eb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.430690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6dc7-f458-48c7-a4c5-21db77c55749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.431339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6dc7-f458-48c7-a4c5-21db77c55749 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.431621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6dc7-f458-48c7-a4c5-21db77c55749 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.431898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6dc7-f458-48c7-a4c5-21db77c55749 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.458967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799d16d-698b-429a-b591-73fb65f1c3f8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.469192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f6dc7-f458-48c7-a4c5-21db77c55749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7e8f6dc7-f458-48c7-a4c5-21db77c55749 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:57.474400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:57.475456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:57.476218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 82/158] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:57.480750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b51b-7230-4070-b59c-8e6ef415569f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.481093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b51b-7230-4070-b59c-8e6ef415569f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.481310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b51b-7230-4070-b59c-8e6ef415569f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.483022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 83/159] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:57.483788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b51b-7230-4070-b59c-8e6ef415569f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:57.521120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de6165-45d9-46a1-834a-7546ec50fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.522316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6165-45d9-46a1-834a-7546ec50fb49 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.522792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6165-45d9-46a1-834a-7546ec50fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.523317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6165-45d9-46a1-834a-7546ec50fb49 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.524684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de6165-45d9-46a1-834a-7546ec50fb49 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.526532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de6165-45d9-46a1-834a-7546ec50fb49 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.528825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 77/160] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:57.530347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.530834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.531299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.551158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:57.552904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:57.587486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:57.629318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:57.650016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 78/161] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:06:57.651255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:57.709231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b51b-7230-4070-b59c-8e6ef415569f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.760999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af221-454d-4726-b66c-f1b06e3467f2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.775126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.775846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.776155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.776543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.777298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:57.777612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.779014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.794116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 84/162] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:57.799758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:57.800777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.801645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.802114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.802681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.803761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] RBAC: Adding query filter params (role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=dd10d0d387e344a28f352cb08913b6b6) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:57.804342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.806051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.812575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 79/163] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/role_assignments?user.id=dd10d0d387e344a28f352cb08913b6b6&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:57.946571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51f75e-5772-4e1a-a04e-3f3dbbe85967 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:57.949037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:57.984990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c991d-8e72-447e-8876-16ab9df8247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:57.985646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c991d-8e72-447e-8876-16ab9df8247a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:57.985926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c991d-8e72-447e-8876-16ab9df8247a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:57.986197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c991d-8e72-447e-8876-16ab9df8247a None admin] PATH_INFO: `/v3/users/f2cd18b2e8434ff589989b4a949311e1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:57.987344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c991d-8e72-447e-8876-16ab9df8247a None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd18b2e8434ff589989b4a949311e1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:57.988965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c991d-8e72-447e-8876-16ab9df8247a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:57.991381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 85/164] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/users/f2cd18b2e8434ff589989b4a949311e1 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:57.996843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.079179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:58.142867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238e25f-2a7f-4003-b1ad-6a83f186b5fb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:58.173828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657f9f-bc00-4e38-b96c-186cead852b4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.174466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657f9f-bc00-4e38-b96c-186cead852b4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.174941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657f9f-bc00-4e38-b96c-186cead852b4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.180259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 86/165] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:58.183377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:58.184056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.184336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.184610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.185754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:58.186134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.186609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.187103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.187203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:58.189122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 80/166] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:57 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:58.194972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.217269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:58.220066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:58.326555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 87/167] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:58.327668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.357764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b8f6-3c45-46e2-8be6-2511550a50fa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:58.389264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:58.424802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c68b8-2902-43f7-9fcf-212156c4fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:58.425584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c68b8-2902-43f7-9fcf-212156c4fa6e None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.425866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c68b8-2902-43f7-9fcf-212156c4fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.426140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c68b8-2902-43f7-9fcf-212156c4fa6e None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/f2cd18b2e8434ff589989b4a949311e1/roles/a311497495e6415e8042a23071507fe4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.430759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c68b8-2902-43f7-9fcf-212156c4fa6e None admin] RBAC: Authorizing `identity:create_grant(project_id=53e7bf2b50344d62823af7a10bf55d7b, user_id=f2cd18b2e8434ff589989b4a949311e1, role_id=a311497495e6415e8042a23071507fe4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:58.432283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c68b8-2902-43f7-9fcf-212156c4fa6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:58.457880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 81/168] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:06:58 2022] PUT /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/users/f2cd18b2e8434ff589989b4a949311e1/roles/a311497495e6415e8042a23071507fe4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:06:58.460999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa44a-9be0-4f41-b12e-f8c7c63b436f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.461532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa44a-9be0-4f41-b12e-f8c7c63b436f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.461814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa44a-9be0-4f41-b12e-f8c7c63b436f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.464172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 82/169] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:58.471726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.472020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.472240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.476543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95a557-26da-4b42-868b-29c3fa0457df None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:58.496343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:58.511640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:06:58.513173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:06:58.554176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:58.557024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.557310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.558226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.584438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:58.597995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:58.598924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:06:58.599737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:06:58.603299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 88/170] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:58.609104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.658371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 83/171] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:06:58.685309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.779612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1a1b0-cee8-4d67-92b5-a2cea422278b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:58.813127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d49e-e122-41e0-abe0-65a1df300344 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:58.823527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:58.853532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:58.854177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.854493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.854767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.868025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:58.873395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:58.874229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:58.874988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 84/172] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:58.875690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:58.876325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:58.876482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:58.877271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:58.877447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:58.877737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:58.879458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:58.881120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.895414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 89/173] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:06:58.901148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:58.947203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:58.992703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb34f-dece-45d9-966f-f845cf66fcc7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.047685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.048504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.048788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.049080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.049788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:59.050095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:59.051497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:59.061372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 85/174] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:59.062366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.099635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:59.118183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8927473-7edf-4a62-8290-53747c25e877 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.188107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81ab3-3f37-4cc3-a525-ac94355dad9e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.212669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.213664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.214138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.214601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] PATH_INFO: `/v3/users/dd10d0d387e344a28f352cb08913b6b6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.223993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10d0d387e344a28f352cb08913b6b6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:59.226186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:59.228214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.228340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 90/175] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:58 2022] GET /identity/v3/users/dd10d0d387e344a28f352cb08913b6b6 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:59.228953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.229232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.229501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.229938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.242580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:06:59.248758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:06:59.249902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:06:59.250741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:06:59.253360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 86/176] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:06:59.254505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.363542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:59.377316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c3e98-f47c-438d-9e4f-0e28f2f30dc4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.417828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.418779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.419235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.419719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.496316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:59.501909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:59.503762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:59.529882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1ba2-4938-4fa4-934f-64b61cd58638 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.610632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:59.623128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.624111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.628682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.629578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] PATH_INFO: `/v3/users/d6d936d32ad542fba7a707cd7eda404b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.630590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 87/177] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:06:59.632176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.632995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d936d32ad542fba7a707cd7eda404b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:59.634638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:59.638815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 91/178] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/users/d6d936d32ad542fba7a707cd7eda404b => generated 247 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:59.641569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.780955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196ea6-bb62-4313-a551-6391155d65a4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.785149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1634-9486-47bb-a624-8b813d373a84 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.819991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.820618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.821154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.821428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.822100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:06:59.822399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:59.823003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.823641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.823794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9873-2459-4502-8d88-f1ee4529d634 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:59.823973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.824224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] PATH_INFO: `/v3/projects/934469f842324ebe99071f1fffcdba12` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.825467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] RBAC: Authorizing `identity:get_project(project_id=934469f842324ebe99071f1fffcdba12)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:06:59.827042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:06:59.833420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 92/179] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/projects/934469f842324ebe99071f1fffcdba12 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:59.833420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.837244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 88/180] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:06:59.838455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1558c-08ea-4693-9c0a-977a5f54bd72 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.840908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1558c-08ea-4693-9c0a-977a5f54bd72 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.840908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1558c-08ea-4693-9c0a-977a5f54bd72 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.840908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 89/181] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:59.843548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04886fa-3959-4a8e-9539-066dc544f8f8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.843548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04886fa-3959-4a8e-9539-066dc544f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.843548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04886fa-3959-4a8e-9539-066dc544f8f8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.845221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 90/182] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:06:59.846299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04886fa-3959-4a8e-9539-066dc544f8f8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:06:59.860893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:59.907942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:06:59.943194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be01e48-5c26-4439-b2d0-dde986edc8c8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.961057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04886fa-3959-4a8e-9539-066dc544f8f8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:06:59.978580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71ed35-aa68-46ed-b81a-0817fedb3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:06:59.979193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ed35-aa68-46ed-b81a-0817fedb3063 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:06:59.979476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ed35-aa68-46ed-b81a-0817fedb3063 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:06:59.979751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ed35-aa68-46ed-b81a-0817fedb3063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:06:59.999545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.000260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.000537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.000811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.001539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=934469f842324ebe99071f1fffcdba12, user.id=dd10d0d387e344a28f352cb08913b6b6) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:00.001844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.003296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.009398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 91/183] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/role_assignments?user.id=dd10d0d387e344a28f352cb08913b6b6&scope.project.id=934469f842324ebe99071f1fffcdba12&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:00.010162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.070580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71ed35-aa68-46ed-b81a-0817fedb3063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.072575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71ed35-aa68-46ed-b81a-0817fedb3063 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.107016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.166280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57844d-340d-451a-ad79-01d1ffc10063 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:00.188299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.200997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 93/184] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:00.203137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.203425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.203703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.216415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed2935-3c84-4d8a-aa55-f45b0f599045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.217060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed2935-3c84-4d8a-aa55-f45b0f599045 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.217341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed2935-3c84-4d8a-aa55-f45b0f599045 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.217615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed2935-3c84-4d8a-aa55-f45b0f599045 None admin] PATH_INFO: `/v3/users/1696384ea2734ad3b04657886acb492b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.227072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:00.228905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:00.237833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed2935-3c84-4d8a-aa55-f45b0f599045 None admin] RBAC: Authorizing `identity:get_user(user_id=1696384ea2734ad3b04657886acb492b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.239172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed2935-3c84-4d8a-aa55-f45b0f599045 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.241369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 92/185] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/users/1696384ea2734ad3b04657886acb492b => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:00.243338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.243624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.243900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.265281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:00.266480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:00.306563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 94/186] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:00.312007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.339815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 93/187] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:00.340627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.384932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.435981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e316740-551e-469e-b1ec-202aa0a8ebfa None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:00.475724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.476406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.476686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.476956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.478092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.479603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.481698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 95/188] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:00.487501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.501890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b38e4-0361-4aa2-974c-07bb63e2fc05 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:00.509715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.559596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.560708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.561203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.561676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.596596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227782a-8814-4296-bd2c-49b547e281b8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:00.632887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.633503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.633788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.634119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.634851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=d6d936d32ad542fba7a707cd7eda404b) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:00.635213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.636721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.643173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 96/189] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/role_assignments?user.id=d6d936d32ad542fba7a707cd7eda404b&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:00.643700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.689361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.692615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.694798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.804917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 94/190] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:00.805787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.810939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.821670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958250b6-14d5-46d9-a56f-ab1d461ff8c6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:00.861795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a093c-6a24-41b3-92fd-bcd2a679d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.862384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a093c-6a24-41b3-92fd-bcd2a679d377 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.862643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a093c-6a24-41b3-92fd-bcd2a679d377 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.862921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a093c-6a24-41b3-92fd-bcd2a679d377 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.875408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a093c-6a24-41b3-92fd-bcd2a679d377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-377a093c-6a24-41b3-92fd-bcd2a679d377 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:00.881845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:00.882764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:00.883634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 97/191] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:00.888042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599af9b-e0f9-4d03-9775-c28f64c46918 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.888333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599af9b-e0f9-4d03-9775-c28f64c46918 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.889105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599af9b-e0f9-4d03-9775-c28f64c46918 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.890407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 98/192] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:00.891129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599af9b-e0f9-4d03-9775-c28f64c46918 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.925011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277c9b-44dd-4391-8277-35b25c952e81 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:00.942374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:00.960217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:00.960855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:00.961140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:00.961412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:00.962541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:00.964033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:00.965611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 95/193] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:00.966369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:00.995979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599af9b-e0f9-4d03-9775-c28f64c46918 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.029662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6a5eb-8f01-4095-9125-439c0405967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.030293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a5eb-8f01-4095-9125-439c0405967c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.030576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a5eb-8f01-4095-9125-439c0405967c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.030858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a5eb-8f01-4095-9125-439c0405967c None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.031982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6a5eb-8f01-4095-9125-439c0405967c None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.033446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6a5eb-8f01-4095-9125-439c0405967c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.035067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 99/194] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:01.035598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:01.036184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.036791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.055912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:01.057137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:01.070682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3795c8-88cb-4c39-afeb-df7ead08f703 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.103992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.104784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.105120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.105438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.106292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:01.106642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.108542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.116981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 96/195] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:01.117729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.122928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 100/196] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:01.123753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.173502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:01.228921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f3fe-2b27-4ed3-8ebb-8fa17d385889 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.232912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abea218-75ac-4dd5-a6e8-dd7f0ee21f48 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.265271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.266265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.266765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.267042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.267371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.267644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.267918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.268226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.268719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.269098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=1696384ea2734ad3b04657886acb492b) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:01.269405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.270674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.270852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.276725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 101/197] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/role_assignments?user.id=1696384ea2734ad3b04657886acb492b&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:01.277492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.284953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:01.306026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 97/198] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:01 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:01.394677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.415339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe430e-17d1-4f13-b8ad-5456be2aa8df None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.431712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:01.466515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.467467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.467467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.467736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] PATH_INFO: `/v3/users/1696384ea2734ad3b04657886acb492b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.470483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] RBAC: Authorizing `identity:get_user(user_id=1696384ea2734ad3b04657886acb492b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.471984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.473614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 102/199] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/users/1696384ea2734ad3b04657886acb492b => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:01.479891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.532114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2fa04-a862-4300-979e-a003dc4c7c7c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.578147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.578960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.579239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.579507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.591634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:01.598850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:01.599705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:01.601226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 98/200] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:01.603838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a06759-8f01-4122-b635-1d924b350c94 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.607346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.653287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.655612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.655612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.655612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.694075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:01.717578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:01.744429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.746648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.776363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca378a2-36c3-4f8b-8a20-3a1e6d9baa41 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:01.816947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:01.817876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:01.818320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:01.818837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:01.819679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:01.820184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:01.822097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:01.831731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 99/201] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:01.838198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.901260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 103/202] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:07:01.906862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:01.985141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56f992-3b9a-4b7f-8bd0-b5c38a002eca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:02.000144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:02.044219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:02.044915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:02.045203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:02.045473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] PATH_INFO: `/v3/users/f2cd18b2e8434ff589989b4a949311e1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:02.047975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd18b2e8434ff589989b4a949311e1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:02.048442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:02.049421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:02.057314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 100/203] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/users/f2cd18b2e8434ff589989b4a949311e1 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:02.065732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:02.076093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b7106-aadf-4ef8-8de8-569926efb79e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:02.133506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:02.135060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:02.135339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:02.135610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:02.137562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:02.139049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:02.141034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 104/204] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:01 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:02.146703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:02.218108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc41ca-c341-44e5-a160-82a958e578b9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:02.254693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:02.255419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:02.255701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:02.256055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:02.309119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:02.331662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:02.333228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:02.403645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79438f-a1aa-4109-9bd4-d6902a48f283 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:02.439473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:02.440471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:02.440952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:02.441431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:02.442354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] RBAC: Adding query filter params (role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=1696384ea2734ad3b04657886acb492b) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:02.442859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:02.444923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:02.451512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:02 2022] GET /identity/v3/role_assignments?user.id=1696384ea2734ad3b04657886acb492b&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:02.466418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 101/206] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:07:02.476210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:02.491831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:02.614389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38518-0fed-400a-88cf-edcf074181ee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:02.660884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d84134-589d-492f-a517-84940a1d2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:02.661877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d84134-589d-492f-a517-84940a1d2201 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:02.662354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d84134-589d-492f-a517-84940a1d2201 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:02.662901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d84134-589d-492f-a517-84940a1d2201 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:02.664283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d84134-589d-492f-a517-84940a1d2201 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:02.665951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d84134-589d-492f-a517-84940a1d2201 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:02.667793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 106/207] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:02 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:02.673821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:02.763584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:02.790574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106b998-a783-4c53-9f66-42cc16223d51 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:02.826556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:02.827170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:02.827451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:02.827720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:02.828490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] RBAC: Adding query filter params (role.id=a311497495e6415e8042a23071507fe4, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b, user.id=f2cd18b2e8434ff589989b4a949311e1) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:02.828800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:02.830256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded3aff-dc53-45e1-8082-7ba9d532e28c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:02.836587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 102/208] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:02 2022] GET /identity/v3/role_assignments?user.id=f2cd18b2e8434ff589989b4a949311e1&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=a311497495e6415e8042a23071507fe4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:03.452122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf58fa-51dd-4bbf-b6ad-f9a142cc0024 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:03.452403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf58fa-51dd-4bbf-b6ad-f9a142cc0024 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:03.452680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf58fa-51dd-4bbf-b6ad-f9a142cc0024 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:03.454305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 107/209] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:03.464007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20f3b-39f0-4112-9572-ce875fc0b063 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:03.464007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20f3b-39f0-4112-9572-ce875fc0b063 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:03.464007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20f3b-39f0-4112-9572-ce875fc0b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:03.480238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-58a20f3b-39f0-4112-9572-ce875fc0b063 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:03.481443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-58a20f3b-39f0-4112-9572-ce875fc0b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:03.552902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:03.777696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624c1-77e3-4a67-ad7e-bdc1751c333c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:03.778216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624c1-77e3-4a67-ad7e-bdc1751c333c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:03.778216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624c1-77e3-4a67-ad7e-bdc1751c333c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:03.779550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 108/211] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:03.784831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:03.785267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:03.785370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:03.817009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:03.818203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:03.861979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f624c1-77e3-4a67-ad7e-bdc1751c333c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:03.916344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 104/212] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:03.966697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:03.988466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f624c1-77e3-4a67-ad7e-bdc1751c333c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.023158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dec2e-dd18-48b2-b811-076881b815f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.024024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dec2e-dd18-48b2-b811-076881b815f3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.024455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dec2e-dd18-48b2-b811-076881b815f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.024878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dec2e-dd18-48b2-b811-076881b815f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.035566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dec2e-dd18-48b2-b811-076881b815f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9e7dec2e-dd18-48b2-b811-076881b815f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:04.040853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:04.041875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:04.042816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:04.044993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 109/213] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:04.052936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.076626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.079150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3aba2-21cd-433d-a862-57f7b8b979e9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.079434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3aba2-21cd-433d-a862-57f7b8b979e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.079771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3aba2-21cd-433d-a862-57f7b8b979e9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.081171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 110/214] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:07:04.087085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.087369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.087637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.105905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:04.107090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:04.156246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be006b-3b97-44c8-aaf2-82718703f1f9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.176336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 111/215] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:04.192218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.193124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.193660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.194161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.195025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:04.195526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.197392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.205920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 105/216] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:04.214821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.220526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.292792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.300486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.328079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c345ae-3ac5-49f0-9958-5569a78c88c9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.339369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366759f1-b17e-429a-8d3c-9d72f527dfc2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.365004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.366484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.366930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.367267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] PATH_INFO: `/v3/users/1696384ea2734ad3b04657886acb492b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.368536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=1696384ea2734ad3b04657886acb492b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.370083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.376486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 112/217] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/users/1696384ea2734ad3b04657886acb492b => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:04.377825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.379255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.380186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.380927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.382358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.383721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.385413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.392682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 106/218] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:04.394753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.499930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84b04-27d0-44b7-a06c-cb4b5f4d9bd2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.510240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c8be6-a647-4e30-a33a-2394545ca2dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.538764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.539450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.539770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.540075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.541240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.542726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.545406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.545969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.546252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.546526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.547168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.548640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.549107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 113/219] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:04.550032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.557085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.559260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.580004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 107/220] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:04 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:04.580004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.682568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33504-d6b9-42a7-8a1b-cf99d032d368 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.720070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c68f7-7086-4fbd-a216-bc468b5a5c12 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.737769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.741660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.741660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.741660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.755991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:04.765221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:04.766164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:04.766925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:04.767523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123544b4-6a7c-4b86-bc60-b3403e2e5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.767523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123544b4-6a7c-4b86-bc60-b3403e2e5294 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.767523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123544b4-6a7c-4b86-bc60-b3403e2e5294 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.767523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123544b4-6a7c-4b86-bc60-b3403e2e5294 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/1696384ea2734ad3b04657886acb492b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.769293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123544b4-6a7c-4b86-bc60-b3403e2e5294 None admin] RBAC: Authorizing `identity:create_grant(project_id=715d4405cd84421196c7c0ddcfbde5a7, user_id=1696384ea2734ad3b04657886acb492b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.769396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 114/221] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:04.770154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:04.770348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123544b4-6a7c-4b86-bc60-b3403e2e5294 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.790892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 108/222] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:04 2022] PUT /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/1696384ea2734ad3b04657886acb492b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:04.797113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6682de-394a-4e84-a7d4-3b71f08c6b2c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.797113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6682de-394a-4e84-a7d4-3b71f08c6b2c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.797113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6682de-394a-4e84-a7d4-3b71f08c6b2c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.797964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 109/223] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:07:04.804429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.804709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.804985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.827076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:04.828345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:04.870325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.904124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:04.927685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a8f6-ac83-48e2-b37e-c7d42fa7a9bc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:04.934097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 110/224] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:04.968584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:04.969150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:04.969435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:04.969770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:04.970390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:04.970696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:04.972109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:04.982126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 115/225] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:04.987630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.106646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa2d92-9a09-4584-9ec8-5cb01d0b51bd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:05.144335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:05.144984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:05.145266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:05.145539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] PATH_INFO: `/v3/users/62d5f6523a4a471abc5e66f21034ff71` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:05.159653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] RBAC: Authorizing `identity:get_user(user_id=62d5f6523a4a471abc5e66f21034ff71)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:05.161213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:05.163749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 111/226] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:04 2022] GET /identity/v3/users/62d5f6523a4a471abc5e66f21034ff71 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:05.169057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.265202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.329345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d6610-b5aa-4886-b1a4-6f7fc48a92eb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:05.334543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:05.370305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:05.384551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:05.385172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:05.385496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:05.385777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:05.400290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c330-572c-4242-85d2-1f7aa24fc761 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:05.446377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:05.447394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:05.447890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:05.448401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:05.485243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:05.486724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:05.488876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:05.494250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:05.495127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:05.496366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 112/227] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:05.502901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.591608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 116/228] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:05.596970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.636904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:05.640780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480282-7a0a-488b-83b8-7243cebee0d1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:05.651822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:05.687057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:05.687680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:05.687982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:05.688252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:05.688925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:05.689225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:05.690627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:05.714674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 113/229] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:05.719054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.786649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c00a5b-8ec2-4c2d-9f69-9428884af830 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:05.840156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:05.840846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:05.841135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:05.841414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:05.842553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:05.844035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:05.846023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 117/230] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:05.857037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.874699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe538603-639c-4bff-b957-9cecba15d1e9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:05.911436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:05.912016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:05.912825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:05.913101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] PATH_INFO: `/v3/users/1696384ea2734ad3b04657886acb492b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:05.914854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] RBAC: Authorizing `identity:get_user(user_id=1696384ea2734ad3b04657886acb492b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:05.916358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:05.918387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 114/231] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/users/1696384ea2734ad3b04657886acb492b => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:05.923608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:05.953038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:06.042209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ed442-f8a0-404f-9be0-8530812e80fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:06.060667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:06.067908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2ac87-86c5-4ac1-8218-51f03866b8c0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:06.088586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:06.089230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:06.089514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:06.089792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:06.090934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:06.093239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:06.100244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 115/232] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:06.103196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:06.125280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:06.126269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:06.126764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:06.127228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:06.128174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=62d5f6523a4a471abc5e66f21034ff71) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:06.128674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:06.131576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae6f17-c584-4c65-9da7-4b1e4cb1dfb5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:06.143272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:05 2022] GET /identity/v3/role_assignments?user.id=62d5f6523a4a471abc5e66f21034ff71&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:06.254677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:06.261641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520d4c-8b37-45bc-88ab-c60e63b8576c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:06.308215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a03b8-9a29-41eb-a45b-e0069863cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:06.308896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a03b8-9a29-41eb-a45b-e0069863cc60 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:06.309181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a03b8-9a29-41eb-a45b-e0069863cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:06.309459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a03b8-9a29-41eb-a45b-e0069863cc60 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/1696384ea2734ad3b04657886acb492b/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:06.312732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a03b8-9a29-41eb-a45b-e0069863cc60 None admin] RBAC: Authorizing `identity:create_grant(project_id=715d4405cd84421196c7c0ddcfbde5a7, user_id=1696384ea2734ad3b04657886acb492b, role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:06.314434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a03b8-9a29-41eb-a45b-e0069863cc60 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:06.333633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:06 2022] PUT /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/1696384ea2734ad3b04657886acb492b/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:07:07.119700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd04533-1de5-4bb6-bdd6-f2141280b87d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.120788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd04533-1de5-4bb6-bdd6-f2141280b87d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.121264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd04533-1de5-4bb6-bdd6-f2141280b87d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.122811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:07.140482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405a57-5329-4eac-a211-9d5a9b3920bc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.141024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405a57-5329-4eac-a211-9d5a9b3920bc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.141024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405a57-5329-4eac-a211-9d5a9b3920bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.158025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e29b3-abc6-454c-ba25-a459fedc4c93 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.158301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e29b3-abc6-454c-ba25-a459fedc4c93 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.158578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e29b3-abc6-454c-ba25-a459fedc4c93 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.160175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 120/236] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:07.163660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e6405a57-5329-4eac-a211-9d5a9b3920bc None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:07.164893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e6405a57-5329-4eac-a211-9d5a9b3920bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:07.166652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.166934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.167207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.194669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:07.196161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:07.280469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 117/237] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:07.281532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aab1b-0e69-4e20-9a98-0f9c5ec4de1e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.283850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aab1b-0e69-4e20-9a98-0f9c5ec4de1e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.283850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aab1b-0e69-4e20-9a98-0f9c5ec4de1e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.283850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 118/238] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:07.286077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 121/239] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:07.288939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.289224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.289501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.311875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:07.313099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:07.387846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 119/240] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:07.601011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:07.615984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:07.629285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:07.721084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:07.743448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2dfa8-1d4c-442b-84a4-ec6be7b3ecf6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:07.782386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e3f96-4732-4b87-b771-71445479b31e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:07.793823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:07.794729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.795211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.795704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.806804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:07.811794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:07.812795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:07.813583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:07.816888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 122/241] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:07.817962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:07.823289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:07.823830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.824160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.824503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.825949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:07.827445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:07.829334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 120/242] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:07.830032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:07.923974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:07.930316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1e33-d4f1-4fec-9f75-885091a69cf4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:07.942096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ded44-7ce7-4131-9d93-bdca6b60e963 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:07.966108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:07.967082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.967642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.968168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.977938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:07.978480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:07.978759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:07.979028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:07.979693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:07.980082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:07.981398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:07.981504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:07.986652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:07.987520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:07.988332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:07.989932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 121/243] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:07.990861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 123/244] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:07.995654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:07.996899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:08.009679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.101095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74045f-487e-43cf-b3d8-37b90a1ba7b0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:08.127028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de454e5-4b23-4f44-b0b0-dea0ae57f943 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:08.141881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:08.142646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.143119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.143534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.144420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:08.146046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:08.166036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:08.166654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.166936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.167511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.168621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:08.168941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:08.170616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:08.173923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 122/245] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:07 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:08.174805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:08.178832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.183683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 124/246] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:08.190555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:08.308813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.342213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660eb39-62a0-4491-b7a4-6bb93f503b9f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:08.383873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:08.384900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.385197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.385480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] PATH_INFO: `/v3/users/60829ebe029d4c389f131797620dd694` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.391755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a46eb-dde3-4885-93e9-97c01418581e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:08.406178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] RBAC: Authorizing `identity:get_user(user_id=60829ebe029d4c389f131797620dd694)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:08.407022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:08.410055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 125/247] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:08 2022] GET /identity/v3/users/60829ebe029d4c389f131797620dd694 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:08.415654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:08.446338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:08.447249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.448135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.448553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] PATH_INFO: `/v3/users/1696384ea2734ad3b04657886acb492b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.450279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=1696384ea2734ad3b04657886acb492b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:08.452236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:08.454719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 123/248] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:08 2022] GET /identity/v3/users/1696384ea2734ad3b04657886acb492b => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:08.460977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:08.549951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.550507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97110faf-c054-4688-b1f6-3f0ca33590ef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:08.589844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.594741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5f4d1-383e-4238-b177-f41016dce6e5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:08.600575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bb469-b445-40d4-9765-f811fcfaa933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:08.601199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb469-b445-40d4-9765-f811fcfaa933 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.601478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb469-b445-40d4-9765-f811fcfaa933 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.601749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb469-b445-40d4-9765-f811fcfaa933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.635482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:08.636152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.636434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.636709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.686657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bb469-b445-40d4-9765-f811fcfaa933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:08.688185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bb469-b445-40d4-9765-f811fcfaa933 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:08.726362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:08.727859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:08.827769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.830177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 126/249] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:08.831667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62774-a712-4ff7-8a8b-c32029c2eeb8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.832182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62774-a712-4ff7-8a8b-c32029c2eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.832691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62774-a712-4ff7-8a8b-c32029c2eeb8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.834506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 127/250] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:08.836121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451fd70-f7e6-4e1e-808c-3b0fea4742a6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.836590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451fd70-f7e6-4e1e-808c-3b0fea4742a6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.837070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451fd70-f7e6-4e1e-808c-3b0fea4742a6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.838460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 128/251] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:08.841062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c28f-031b-493c-b939-ad2ef81ec80a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.841630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c28f-031b-493c-b939-ad2ef81ec80a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.842126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c28f-031b-493c-b939-ad2ef81ec80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.868119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7045c28f-031b-493c-b939-ad2ef81ec80a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:08.870580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7045c28f-031b-493c-b939-ad2ef81ec80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:08.873296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 124/252] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:08.878162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:08.900709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:08.945430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 129/253] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:08.947129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:08.947417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:08.947688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:08.965803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:08.967006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:08.996243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b379-065c-4668-a9a1-f8a1a6b5f4f3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.060585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.061230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.061512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.061786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.063696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:09.065880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:09.069419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 125/254] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:08 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:09.072238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.081934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 130/255] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:09.085468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.156190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:09.265767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:09.275134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4db49d-af15-4dad-9b06-0af78e620e15 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.284381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98e398-bbae-43a2-9e0c-00663b1adbd7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.333090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.333723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.334520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.334793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.336045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:09.337498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:09.341201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 126/256] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:09.343802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.352023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.352645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.352922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.353194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.353926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] RBAC: Adding query filter params (role.id=a311497495e6415e8042a23071507fe4, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=60829ebe029d4c389f131797620dd694) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:09.354234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:09.355668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:09.368786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 131/257] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/role_assignments?user.id=60829ebe029d4c389f131797620dd694&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=a311497495e6415e8042a23071507fe4 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:09.369392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.551275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9433e1-c262-4085-bc49-fce8ac19213b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.554792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41b84-a4ed-41d5-8232-b3ef63cbd6fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.566979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:09.619976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.620974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.621260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.621538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.623329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.623944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.624245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.624516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.625328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=1696384ea2734ad3b04657886acb492b) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:09.625643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:09.627127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:09.637844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 132/258] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/role_assignments?user.id=1696384ea2734ad3b04657886acb492b&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:09.638709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.648450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:09.653483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:09.654446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:09.655675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 127/259] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:09.664965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.672604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:09.770242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ea08-0d8b-4619-a32f-5e098e4f4347 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.838142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.839175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.839642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.839918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.869012 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:09.873917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:09.874756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:09.875525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 133/260] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:09.883511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:09.907010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985e0b-caec-41be-9081-f92a66aebddd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:09.971520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:09.972507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:09.972981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:09.973460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:09.974390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:09.975472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:09.977134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:09.989252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 128/261] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:09.998882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.018748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.046552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.066402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002afc5e-be47-4157-8805-99120cc5a4c9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.121610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.122545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.123019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.123515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.124460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:10.124956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.126578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.138620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 134/262] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:10.144190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.173221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7826188-83f2-44ce-ab2a-7507206c6f52 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.208620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.209304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.209600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.210095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] PATH_INFO: `/v3/users/62d5f6523a4a471abc5e66f21034ff71` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.210966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] RBAC: Authorizing `identity:get_user(user_id=62d5f6523a4a471abc5e66f21034ff71)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.212516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.214535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 129/263] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:09 2022] GET /identity/v3/users/62d5f6523a4a471abc5e66f21034ff71 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:10.224969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.253688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a54a8-af04-47a8-9dfb-49865e94ced7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.289833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.291289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.291805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.292295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] PATH_INFO: `/v3/users/1696384ea2734ad3b04657886acb492b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.293715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] RBAC: Authorizing `identity:get_user(user_id=1696384ea2734ad3b04657886acb492b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.295344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.297218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 135/264] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:10 2022] GET /identity/v3/users/1696384ea2734ad3b04657886acb492b => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:10.302923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.322184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.426577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47400f62-09d8-4d6f-a967-5b280a2c9f7c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.463600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.464600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.465359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.465850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.468316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.493893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95bfd-b847-4835-8c8f-d0aa473f7f40 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.539411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.541573 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.551696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.585617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.586287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.586566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.586837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.587983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.589423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.595652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 130/265] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:10 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:10.600841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.650280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 136/266] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:07:10.655384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.758954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12fa2f-1c2a-4b56-b409-c39a0ef96de0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.793886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc734-1eb2-4d81-9799-87ade578ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.794551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc734-1eb2-4d81-9799-87ade578ae10 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.794880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc734-1eb2-4d81-9799-87ade578ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.795162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc734-1eb2-4d81-9799-87ade578ae10 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/62d5f6523a4a471abc5e66f21034ff71/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.797099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc734-1eb2-4d81-9799-87ade578ae10 None admin] RBAC: Authorizing `identity:create_grant(project_id=715d4405cd84421196c7c0ddcfbde5a7, user_id=62d5f6523a4a471abc5e66f21034ff71, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.798606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc734-1eb2-4d81-9799-87ade578ae10 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.811666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b83f26-a38d-4c08-a00f-091c1cfd1647 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:10.813595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 131/267] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:10 2022] PUT /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/62d5f6523a4a471abc5e66f21034ff71/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:10.815264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439152a-4068-4f23-9fcc-bbd10937533a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.815564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439152a-4068-4f23-9fcc-bbd10937533a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.815924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439152a-4068-4f23-9fcc-bbd10937533a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.817251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 132/268] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:10.823914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d760235-b5cb-4a7e-92fc-680ba479b0da None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.824271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d760235-b5cb-4a7e-92fc-680ba479b0da None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.824549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d760235-b5cb-4a7e-92fc-680ba479b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.826069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.866795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8d760235-b5cb-4a7e-92fc-680ba479b0da None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:10.868301 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8d760235-b5cb-4a7e-92fc-680ba479b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:10.891299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:10.891486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:10.892011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.892406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.892756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.894342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:10.902118 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:10.904020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:10 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:10.909956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:10.971350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 133/270] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:10.989196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a199e-2c72-4ae8-9bd0-ba2c92270603 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.989802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a199e-2c72-4ae8-9bd0-ba2c92270603 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.990844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a199e-2c72-4ae8-9bd0-ba2c92270603 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:10.996148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 134/271] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:07:10.998606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:10.999099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:10.999578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.020997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:11.023448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:11.101545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0558ae-34d4-4ee3-b97c-9dfe66dee6eb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:11.105194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 135/272] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:11.139004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:11.139618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.139901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.140206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.140938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] RBAC: Adding query filter params (role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=1696384ea2734ad3b04657886acb492b) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:11.141246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:11.142707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:11.148828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 138/273] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:10 2022] GET /identity/v3/role_assignments?user.id=1696384ea2734ad3b04657886acb492b&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:11.290934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:11.389749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:11.407457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e22b64-332e-40a1-9e48-656d92f5d2a1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:11.443051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:11.443741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.444044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.444318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.455405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:11.456197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:11.460904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:11.461758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:11.462928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 136/274] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:11.467831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:11.517446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:11.590197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3256c-5e92-4b35-8770-464eb8267093 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:11.594052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd9ac-f9b6-4d77-b103-10eaccacf052 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:11.627400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:11.628052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.628440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.628716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.629388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:11.629699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:11.631889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:11.632127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:11.632769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.633077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.633427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.634606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:11.636130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:11.638019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 139/275] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:11.640588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 137/276] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:11.643141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:11.646765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:11.658378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:11.781281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a8e49-64a8-43c6-bfad-caa225dfe6c9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:11.786819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2292c-7f65-4458-a510-832240e05780 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:11.793681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:11.825278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:11.825914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.826195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.826468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] PATH_INFO: `/v3/users/650254d1b1b84e0d9be3d8763e697210` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.828939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eec7ed-06a3-4d51-821b-1f783903dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:11.830672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eec7ed-06a3-4d51-821b-1f783903dbca None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.831163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eec7ed-06a3-4d51-821b-1f783903dbca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.831659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eec7ed-06a3-4d51-821b-1f783903dbca None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.832556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eec7ed-06a3-4d51-821b-1f783903dbca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:11.834320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eec7ed-06a3-4d51-821b-1f783903dbca None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:11.840562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] RBAC: Authorizing `identity:get_user(user_id=650254d1b1b84e0d9be3d8763e697210)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:11.841999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:11.848619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 138/277] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:11 2022] GET /identity/v3/users/650254d1b1b84e0d9be3d8763e697210 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:11.851186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:11.869800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 140/278] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:11 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:11.871037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83561-8ef6-4a6f-8d0e-5fdbf851b290 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.871321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83561-8ef6-4a6f-8d0e-5fdbf851b290 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.871619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83561-8ef6-4a6f-8d0e-5fdbf851b290 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.883523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 141/279] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:11.889486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:11.889792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:11.890048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:11.911283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:11.913492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:11.947422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:12.000574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 142/280] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:12.003498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e6ca7-63d1-4bd0-8941-b5ab4f0d91c2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:12.042493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:12.043112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:12.043396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:12.043670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:12.044443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, user.id=650254d1b1b84e0d9be3d8763e697210, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:12.044753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:12.046210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:12.051685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 139/281] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Aug 17 14:07:11 2022] GET /identity/v3/role_assignments?user.id=650254d1b1b84e0d9be3d8763e697210&scope.system=all&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:12.272745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:12.373777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:12.381616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15fe15-0e8c-4b06-b527-e46b83e8ed14 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:12.420067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:12.420709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:12.420987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:12.421259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:12.436264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:12.440976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:12.441837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:12.442630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 143/282] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:12.448947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:12.564701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e40f-c99b-4151-9bde-0a4ba81d57f8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:12.599804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:12.608651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:12.611234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:12.611518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:12.611794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:12.612494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:12.612796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:12.614351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:12.627495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 140/283] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:12.633530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:12.772145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fd3c-31f9-401f-9ea3-f35d7b6e4110 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:12.821315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:12.821870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:12.822152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:12.822427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] PATH_INFO: `/v3/users/60829ebe029d4c389f131797620dd694` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:12.823563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] RBAC: Authorizing `identity:get_user(user_id=60829ebe029d4c389f131797620dd694)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:12.825057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:12.826796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 144/284] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:12 2022] GET /identity/v3/users/60829ebe029d4c389f131797620dd694 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:12.832271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:12.972730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736808-3b49-437b-a13d-8e72dbe4bcc5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:13.009696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bca18-15e9-4dff-bf27-9cf0c45056be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:13.010326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bca18-15e9-4dff-bf27-9cf0c45056be None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:13.010607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bca18-15e9-4dff-bf27-9cf0c45056be None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:13.010873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bca18-15e9-4dff-bf27-9cf0c45056be None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:13.012005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bca18-15e9-4dff-bf27-9cf0c45056be None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:13.013453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bca18-15e9-4dff-bf27-9cf0c45056be None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:13.015462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 141/285] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:12 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:13.021187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:13.059116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:13.097316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815ec6-e780-4718-a837-c90403c783e9 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:13.097936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815ec6-e780-4718-a837-c90403c783e9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:13.098400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815ec6-e780-4718-a837-c90403c783e9 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:13.100633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 142/286] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:13.106309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:13.107004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:13.107606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:13.143791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:13.145323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:13.145429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf206d9-69f9-49e3-9d7f-112d6959ac1b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:13.187615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:13.188310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:13.188588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:13.188860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/60829ebe029d4c389f131797620dd694/roles/a311497495e6415e8042a23071507fe4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:13.191809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] RBAC: Authorizing `identity:create_grant(project_id=715d4405cd84421196c7c0ddcfbde5a7, user_id=60829ebe029d4c389f131797620dd694, role_id=a311497495e6415e8042a23071507fe4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:13.193854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:13.217605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 145/287] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:13 2022] PUT /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/users/60829ebe029d4c389f131797620dd694/roles/a311497495e6415e8042a23071507fe4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:13.244409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:13.261828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 143/288] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:13.602195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:13.687851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:13.707590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218ed5-4f26-4c8e-a01c-fb02cb99069a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:13.742760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:13.743647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:13.743647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:13.747989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:13.754437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:13.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:13.760700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:13.761499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:13.765786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 146/289] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:13.767257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:13.892265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a95f8-fba9-497f-a8f7-d06645d01e8d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:13.939041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:13.939666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:13.939945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:13.940241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:13.940920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:13.941228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:13.942606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:13.956120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 144/290] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:13.958446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:14.094751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8c274-25c7-43d9-96ce-1592abc19f77 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:14.140199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b5e8-8f7d-4697-b199-bf929025f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:14.140842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b5e8-8f7d-4697-b199-bf929025f33a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.141126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b5e8-8f7d-4697-b199-bf929025f33a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.141402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b5e8-8f7d-4697-b199-bf929025f33a None admin] PATH_INFO: `/v3/users/62d5f6523a4a471abc5e66f21034ff71` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.142585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b5e8-8f7d-4697-b199-bf929025f33a None admin] RBAC: Authorizing `identity:get_user(user_id=62d5f6523a4a471abc5e66f21034ff71)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:14.144113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b5e8-8f7d-4697-b199-bf929025f33a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:14.145989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 147/291] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:13 2022] GET /identity/v3/users/62d5f6523a4a471abc5e66f21034ff71 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:14.152104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:14.208334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:14.283716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83fda-bd21-4c89-8f51-9e17d12c127c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:14.331060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:14.332059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.332545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.333012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.398409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dca8c-ba12-4316-bc07-6e3978f3e5eb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.398705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dca8c-ba12-4316-bc07-6e3978f3e5eb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.398887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dca8c-ba12-4316-bc07-6e3978f3e5eb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.400415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 148/292] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:14.407246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f511-d6c1-4e61-aa69-aef31b7967c6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.407535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f511-d6c1-4e61-aa69-aef31b7967c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.407815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f511-d6c1-4e61-aa69-aef31b7967c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.433617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-55f9f511-d6c1-4e61-aa69-aef31b7967c6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:14.434825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-55f9f511-d6c1-4e61-aa69-aef31b7967c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:14.456320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:14.456639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:14.458122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:14.529090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:14.536693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 149/293] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:14.545257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9f58-1856-452b-82d4-bb505cc6b8f4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.545554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9f58-1856-452b-82d4-bb505cc6b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.545835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9f58-1856-452b-82d4-bb505cc6b8f4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.547113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 150/294] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:14.559649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.560206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.560851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.595240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:14.598267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:14.613235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 145/295] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:14.629523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:14.737886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:14.793739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b436e-bcb0-4303-9a28-4d24de985c3e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:14.839637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:14.841916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589463-5219-49c3-8a9f-6df3fa5f5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:14.842561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589463-5219-49c3-8a9f-6df3fa5f5e7e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.842842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589463-5219-49c3-8a9f-6df3fa5f5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.843117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589463-5219-49c3-8a9f-6df3fa5f5e7e None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.844279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589463-5219-49c3-8a9f-6df3fa5f5e7e None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:14.845724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589463-5219-49c3-8a9f-6df3fa5f5e7e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:14.847491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 146/297] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:14 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:14.848498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb78ae-7aaf-45bf-b83d-759c19f936a2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:14.848776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb78ae-7aaf-45bf-b83d-759c19f936a2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:14.849044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb78ae-7aaf-45bf-b83d-759c19f936a2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:14.850953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 147/298] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:14.855908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb78ae-7aaf-45bf-b83d-759c19f936a2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:14.892310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:14.927095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:14.967108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9af6a-68cc-476e-a98e-253ac0f580a5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:14.991979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb78ae-7aaf-45bf-b83d-759c19f936a2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.003898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631820e-e44f-4c77-a581-24a081584015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.005021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631820e-e44f-4c77-a581-24a081584015 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.006053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631820e-e44f-4c77-a581-24a081584015 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.006549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631820e-e44f-4c77-a581-24a081584015 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.017975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631820e-e44f-4c77-a581-24a081584015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1631820e-e44f-4c77-a581-24a081584015 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:15.023692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:15.024577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:15.025341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:15.027664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 152/299] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:15.032430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.032430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.032430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.032430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.033103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=62d5f6523a4a471abc5e66f21034ff71) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:15.033418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.034600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.034870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.035295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.035844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.041839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 148/300] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:14 2022] GET /identity/v3/role_assignments?user.id=62d5f6523a4a471abc5e66f21034ff71&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:15.042691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.057480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:15.059060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:15.151733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.155250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 153/301] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:15.161132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.174871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385e04b-4854-4021-8cb9-02548e31e4b7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.230477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.231283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.231571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.231878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.232780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:15.233089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.235404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.248164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 149/302] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:15.253799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.265816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.322415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479366af-1ebc-4de2-b59f-7d0109c6f44e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.362938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.363584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.363868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.364311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.375846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb7a9-a7e3-44c8-b172-30977acade5d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.379946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:15.386112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:15.386974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:15.388190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 154/303] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:15.394334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.432583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.433776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.434230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.434669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] PATH_INFO: `/v3/users/650254d1b1b84e0d9be3d8763e697210` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.436019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] RBAC: Authorizing `identity:get_user(user_id=650254d1b1b84e0d9be3d8763e697210)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.438814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.440661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 150/304] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/users/650254d1b1b84e0d9be3d8763e697210 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:15.448621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.465550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.519282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bebed-ef77-4ef8-8eca-e7874dbc0b3d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.540224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.554517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.555332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.555610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.555887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.556575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:15.556880 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.558252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.560385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b895-8598-4e2c-93c1-26530a0b9f7c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.566411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 155/305] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:15.567729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.594149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9fa1a-49b9-4c46-a5ec-7fa7b0d2364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.594797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9fa1a-49b9-4c46-a5ec-7fa7b0d2364c None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.595070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9fa1a-49b9-4c46-a5ec-7fa7b0d2364c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.595341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9fa1a-49b9-4c46-a5ec-7fa7b0d2364c None admin] PATH_INFO: `/v3/system/users/650254d1b1b84e0d9be3d8763e697210/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.596763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9fa1a-49b9-4c46-a5ec-7fa7b0d2364c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=650254d1b1b84e0d9be3d8763e697210, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.598137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9fa1a-49b9-4c46-a5ec-7fa7b0d2364c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.607109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 151/306] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Aug 17 14:07:15 2022] PUT /identity/v3/system/users/650254d1b1b84e0d9be3d8763e697210/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:07:15.608506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30771c97-e635-49cb-8248-9084f4e982c5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.608790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30771c97-e635-49cb-8248-9084f4e982c5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.609064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30771c97-e635-49cb-8248-9084f4e982c5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.615059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 152/307] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:15.615059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30771c97-e635-49cb-8248-9084f4e982c5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.681517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a167da-6d10-4767-b2cd-3de1a8509430 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.705918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.721841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ba65-dde2-444a-9e69-8d9d018d8c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.722481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ba65-dde2-444a-9e69-8d9d018d8c40 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.722875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ba65-dde2-444a-9e69-8d9d018d8c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.723148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ba65-dde2-444a-9e69-8d9d018d8c40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.725521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ba65-dde2-444a-9e69-8d9d018d8c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.726490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ba65-dde2-444a-9e69-8d9d018d8c40 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.728327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 156/308] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:15.731649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.731649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.731649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.743992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30771c97-e635-49cb-8248-9084f4e982c5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.753566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:15.754752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:15.786010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.787476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.787764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.788160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] PATH_INFO: `/v3/users/0a9860ecb85842b6bb9a45fc72c782fa` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.803196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9860ecb85842b6bb9a45fc72c782fa)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.803791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.805381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.812064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 153/309] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/users/0a9860ecb85842b6bb9a45fc72c782fa => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:15.812064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.830888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 157/310] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:15.831725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:15.929526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054399fa-f410-48fd-a6ed-e68f387dc167 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.939168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56c845-4016-4db6-8c42-d96636baf814 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:15.966353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.967310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.967793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.968309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] PATH_INFO: `/v3/groups` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.969127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.970767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.975852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:15.976086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:15.976925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:15.977222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:15.977494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:15.978500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] RBAC: Adding query filter params (role.id=a311497495e6415e8042a23071507fe4, user.id=0a9860ecb85842b6bb9a45fc72c782fa, scope.system=all) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:15.978805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:15.980365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:15.988011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 158/311] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Aug 17 14:07:15 2022] GET /identity/v3/role_assignments?user.id=0a9860ecb85842b6bb9a45fc72c782fa&scope.system=all&role.id=a311497495e6415e8042a23071507fe4 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:16.000124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 154/312] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Aug 17 14:07:15 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:16.100774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:16.163217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:16.223603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5cbf-dce3-4de7-a907-65283dcf071a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:16.259389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:16.260064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:16.260346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:16.260625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:16.271487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:16.276352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:16.277211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:16.277982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 159/313] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:16.284858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:16.388107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bc36-a6bd-4ce2-b829-32065a683560 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:16.422854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:16.423693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:16.424191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:16.424604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:16.425414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:16.425858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:16.427537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:16.436555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 155/314] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:16.442242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:16.554071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334092c-8c0c-4977-a33d-004bc18dd9fd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:16.556695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:16.591681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:16.592692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:16.593147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:16.593621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] PATH_INFO: `/v3/users/60829ebe029d4c389f131797620dd694` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:16.594899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=60829ebe029d4c389f131797620dd694)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:16.596516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:16.598536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 160/315] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:16 2022] GET /identity/v3/users/60829ebe029d4c389f131797620dd694 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:16.604894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:16.670019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:16.717000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec75dc-1953-49a2-be52-bcea45a143df None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:16.751519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:16.752176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:16.752592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:16.752869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:16.823357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:16.824939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:16.880945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:16.931445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 156/316] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:16.936953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:17.046310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec3176-5adf-4389-a6e5-cd61a1d26ea8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:17.082019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef382dd-a5eb-4171-9315-117b17e350d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:17.082654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef382dd-a5eb-4171-9315-117b17e350d6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:17.082988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef382dd-a5eb-4171-9315-117b17e350d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:17.083264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef382dd-a5eb-4171-9315-117b17e350d6 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:17.084489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef382dd-a5eb-4171-9315-117b17e350d6 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:17.085948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef382dd-a5eb-4171-9315-117b17e350d6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:17.087929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 161/317] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:16 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:17.093557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:17.202017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3054-9325-4da4-9af1-b2e7abd43c61 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:17.237894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:17.238510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:17.238796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:17.239070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:17.239865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] RBAC: Adding query filter params (role.id=a311497495e6415e8042a23071507fe4, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7, user.id=60829ebe029d4c389f131797620dd694) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:17.240259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:17.241707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae047d-69db-4c93-9ea5-e85fd2a66c54 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:17.248145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 157/318] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:17 2022] GET /identity/v3/role_assignments?user.id=60829ebe029d4c389f131797620dd694&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=a311497495e6415e8042a23071507fe4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:17.525908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908bb06-0989-4999-a6e2-333dfcc297e4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:17.526248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908bb06-0989-4999-a6e2-333dfcc297e4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:17.526419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908bb06-0989-4999-a6e2-333dfcc297e4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:17.527852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 162/319] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:17.532816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998492d8-aa09-4c65-bbab-82f065f3efcf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:17.533103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998492d8-aa09-4c65-bbab-82f065f3efcf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:17.533377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998492d8-aa09-4c65-bbab-82f065f3efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:17.550845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-998492d8-aa09-4c65-bbab-82f065f3efcf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:17.552596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-998492d8-aa09-4c65-bbab-82f065f3efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:17.567308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:17.623845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 158/320] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:17.894901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908bb06-0989-4999-a6e2-333dfcc297e4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:17.939906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:17.977759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7a632-5bbc-44de-adb0-267f73b285bf None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:17.978269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7a632-5bbc-44de-adb0-267f73b285bf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:17.978391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7a632-5bbc-44de-adb0-267f73b285bf None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:17.979643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 159/321] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:17.984489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb87a7-0131-48e8-a44c-aa400ecc0b05 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:17.984782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb87a7-0131-48e8-a44c-aa400ecc0b05 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:17.985058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb87a7-0131-48e8-a44c-aa400ecc0b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.002868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908bb06-0989-4999-a6e2-333dfcc297e4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.003269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b9fb87a7-0131-48e8-a44c-aa400ecc0b05 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:18.004499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b9fb87a7-0131-48e8-a44c-aa400ecc0b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:18.039667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.040334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.040613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.040940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.052795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:18.057721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:18.058569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:18.060709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 163/322] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:18.064761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.079997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 160/323] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:18.099871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55a73d-64de-4c1e-b987-ba466d46539b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.100292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55a73d-64de-4c1e-b987-ba466d46539b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.100568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55a73d-64de-4c1e-b987-ba466d46539b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.101867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 161/324] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:07:18.108094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.108457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.108735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.126657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:18.127941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:18.172229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:18.175303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc4ed0-d681-4eae-9d44-674a62eb66d6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.195047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 162/325] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:18.212960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.213565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.213849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.214126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.214845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:18.215156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.216575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.229108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 164/326] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:18.230245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.243162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:18.333040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98a04-256f-4fb4-94b6-6cefc5d866e9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.350263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.369122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.369759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.370040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.370320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] PATH_INFO: `/v3/users/650254d1b1b84e0d9be3d8763e697210` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.371443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] RBAC: Authorizing `identity:get_user(user_id=650254d1b1b84e0d9be3d8763e697210)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.372939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.374525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 163/327] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/users/650254d1b1b84e0d9be3d8763e697210 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:18.380225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.459293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:18.459847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f115b4-6e67-46e2-a1f1-33be7fe0ca7a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.481755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07657f3-d41d-4d64-a501-cd0a61805b30 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.495643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.496311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.496592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.496864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.506854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:18.512092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:18.513107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 165/328] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:18.514080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.518634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.519244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.519522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.519792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.520555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] RBAC: Adding query filter params (role.id=cd1209cf9c93469fab17d5f0e1fea91e, user.id=650254d1b1b84e0d9be3d8763e697210, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:18.521396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.522824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.534432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 164/329] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/role_assignments?user.id=650254d1b1b84e0d9be3d8763e697210&scope.system=all&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:18.535364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.542649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:18.633389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41af3b8-8297-487a-ab2c-60ff1cc479dd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.651321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44f2b-ee1d-4129-85bc-4ba43509fc62 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.669707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.670354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.670628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.670899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.672011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.673463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.675022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 166/330] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:18.681073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.695114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.695999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.696290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.696676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.697354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:18.697660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.699195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.704677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:18.709781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 165/331] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:18.716066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.778490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:18.788981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fe481-24f2-41c7-9668-6f9ad03592d8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.822678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.823290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.823570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.823844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] PATH_INFO: `/v3/groups` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.824493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.824679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcec47-b5c3-4799-a707-65de41024d70 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:18.825936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.841632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 167/332] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Aug 17 14:07:18 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:07:18.860577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1305-b1a9-485a-bb96-f52b5ff7c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:18.861237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1305-b1a9-485a-bb96-f52b5ff7c79d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:18.861520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1305-b1a9-485a-bb96-f52b5ff7c79d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:18.861795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1305-b1a9-485a-bb96-f52b5ff7c79d None admin] PATH_INFO: `/v3/users/0a9860ecb85842b6bb9a45fc72c782fa` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:18.862998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1305-b1a9-485a-bb96-f52b5ff7c79d None admin] RBAC: Authorizing `identity:get_user(user_id=0a9860ecb85842b6bb9a45fc72c782fa)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:18.865141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1305-b1a9-485a-bb96-f52b5ff7c79d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:18.866830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 166/333] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:18 2022] GET /identity/v3/users/0a9860ecb85842b6bb9a45fc72c782fa => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:18.872781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:18.979194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5347a-fb45-4add-a002-7d394df6c71e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:19.012225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d40804-4e0b-440c-9038-cbdc36518b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:19.012871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d40804-4e0b-440c-9038-cbdc36518b47 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:19.013150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d40804-4e0b-440c-9038-cbdc36518b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:19.013421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d40804-4e0b-440c-9038-cbdc36518b47 None admin] PATH_INFO: `/v3/system/users/0a9860ecb85842b6bb9a45fc72c782fa/roles/a311497495e6415e8042a23071507fe4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:19.014871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d40804-4e0b-440c-9038-cbdc36518b47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a9860ecb85842b6bb9a45fc72c782fa, role_id=a311497495e6415e8042a23071507fe4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:19.016289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d40804-4e0b-440c-9038-cbdc36518b47 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:19.025843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 168/334] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Aug 17 14:07:18 2022] PUT /identity/v3/system/users/0a9860ecb85842b6bb9a45fc72c782fa/roles/a311497495e6415e8042a23071507fe4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:20.965393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91483d71-11a1-4d4f-99e5-8bca21d3268e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:20.965898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91483d71-11a1-4d4f-99e5-8bca21d3268e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:20.966005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91483d71-11a1-4d4f-99e5-8bca21d3268e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:20.967447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 167/335] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:20.972646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05751a-dd4f-4f92-95e8-919210d5eefe None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:20.973069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05751a-dd4f-4f92-95e8-919210d5eefe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:20.973245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05751a-dd4f-4f92-95e8-919210d5eefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:20.993513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bd05751a-dd4f-4f92-95e8-919210d5eefe None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:20.994637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bd05751a-dd4f-4f92-95e8-919210d5eefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:21.005911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:21.085286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 169/336] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:21.143288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13858b-779a-4b04-a0d0-cf2a5d61b7e0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.143611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13858b-779a-4b04-a0d0-cf2a5d61b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.143840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13858b-779a-4b04-a0d0-cf2a5d61b7e0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:21.145208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 168/337] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:21.151436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4d021-7432-48e3-a126-4bdbe6f37127 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.151722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4d021-7432-48e3-a126-4bdbe6f37127 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.152017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4d021-7432-48e3-a126-4bdbe6f37127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:21.174561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d0a4d021-7432-48e3-a126-4bdbe6f37127 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:21.175758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d0a4d021-7432-48e3-a126-4bdbe6f37127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:21.261690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 170/338] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:21.494210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13858b-779a-4b04-a0d0-cf2a5d61b7e0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:21.514078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14773f-295c-401e-803b-489ae3bbf7f9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.514382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14773f-295c-401e-803b-489ae3bbf7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.514550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14773f-295c-401e-803b-489ae3bbf7f9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:21.516083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 171/339] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:07:21.523861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.524156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.524430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:21.550705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:21.551938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:21.621228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:21.662191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 172/340] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:21.688994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:21.703982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:21.715443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13858b-779a-4b04-a0d0-cf2a5d61b7e0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:21.792210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a2461-89f5-40e1-9b1a-ca212d1048e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:21.793077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a2461-89f5-40e1-9b1a-ca212d1048e6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.793599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a2461-89f5-40e1-9b1a-ca212d1048e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.794018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a2461-89f5-40e1-9b1a-ca212d1048e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:21.813439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a2461-89f5-40e1-9b1a-ca212d1048e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-547a2461-89f5-40e1-9b1a-ca212d1048e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:21.819055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:21.820397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:21.821388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:21.825764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 169/341] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:21.828473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429b7d-737e-461f-acc2-51c7e860687c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.830959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429b7d-737e-461f-acc2-51c7e860687c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.832102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429b7d-737e-461f-acc2-51c7e860687c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:21.834267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 170/342] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:21.835411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429b7d-737e-461f-acc2-51c7e860687c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:21.929656 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609f585-dd70-47c2-9562-ef6457a3ee35 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:21.975261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429b7d-737e-461f-acc2-51c7e860687c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:21.997142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7a945-6ddd-476f-b74b-f34ee3493cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:21.998028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a945-6ddd-476f-b74b-f34ee3493cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:21.998406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a945-6ddd-476f-b74b-f34ee3493cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:21.998777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a945-6ddd-476f-b74b-f34ee3493cc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.014153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:22.027911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7a945-6ddd-476f-b74b-f34ee3493cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6bb7a945-6ddd-476f-b74b-f34ee3493cc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:22.034051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:22.034944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:22.035743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 173/343] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:22.037132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.037132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.037132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.040751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.041701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.042333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.042805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.043734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:22.044303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:22.046012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:22.056775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 171/344] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:22.057853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.064139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:22.065637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:22.133360 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:22.144000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:22.146188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.194646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c28c-4a1e-45b3-b2c4-b94b026c0ca8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.247451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.248134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.248415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.248683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.257488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238ca7d-3174-4332-8baa-d59dcb0630b5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.263869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:22.272576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:22.273496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:22.274326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 172/346] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:22.274983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.306578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.308231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.309395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.310679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.311625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:22.313005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:22.314764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:22.335600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 175/347] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:22.337561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.378291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:22.459342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:22.472050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d394-d382-46a0-b9db-bed6f40a8a63 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.512551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ef8b-9db5-4b8c-91fd-275e3636a565 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.528800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.529426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.529706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.529979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.587605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.589341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.589341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.589341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.589578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:22.589756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:22.591080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:22.601850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 176/348] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:22.602487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.621341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:22.623890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:22.684340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:22.718892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ec28b-4d17-417c-a841-f53569b43b72 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.736974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:22.753062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 173/349] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:22.753930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.766171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.766814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.767093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.767364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] PATH_INFO: `/v3/users/0a9860ecb85842b6bb9a45fc72c782fa` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.768587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] RBAC: Authorizing `identity:get_user(user_id=0a9860ecb85842b6bb9a45fc72c782fa)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:22.770052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:22.772299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 177/350] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/users/0a9860ecb85842b6bb9a45fc72c782fa => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:22.773123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.887002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c433-84f4-4bec-9fb6-1bf22eb1256e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.909515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865a1f2-5052-4306-81a2-09b9536ef0db None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:22.928111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.928993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.929456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.929913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.944833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:22.949986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:22.950841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:22.951627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 174/351] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:22.952349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:22.962105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1073ac-3248-459d-969b-c47f8c6d6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:22.962284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1073ac-3248-459d-969b-c47f8c6d6679 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:22.962538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1073ac-3248-459d-969b-c47f8c6d6679 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:22.962815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1073ac-3248-459d-969b-c47f8c6d6679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:22.969788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.042379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.060936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1073ac-3248-459d-969b-c47f8c6d6679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.062426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1073ac-3248-459d-969b-c47f8c6d6679 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.102267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33d42-edbd-4bc4-a7d1-1d0d59da3fb2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.142903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.143368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.143652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.143927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.145099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.146610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.148437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 175/352] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:23.149510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.190521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 178/353] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:23.196148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96debe-d826-4a35-874a-040ade2e21c1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.196704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96debe-d826-4a35-874a-040ade2e21c1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.197255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96debe-d826-4a35-874a-040ade2e21c1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.198608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 179/354] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:23.202716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96debe-d826-4a35-874a-040ade2e21c1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.256476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.286750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d5849-9df8-464a-a872-97fd3d89ba0f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.313943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.331565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.331944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96debe-d826-4a35-874a-040ade2e21c1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.332692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.333231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.333826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.334569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] RBAC: Adding query filter params (role.id=a311497495e6415e8042a23071507fe4, user.id=0a9860ecb85842b6bb9a45fc72c782fa, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:23.334884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.336368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.355988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 176/355] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/role_assignments?user.id=0a9860ecb85842b6bb9a45fc72c782fa&scope.system=all&role.id=a311497495e6415e8042a23071507fe4 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:23.355988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.383924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.384653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.384936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.385213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.385884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:23.386524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.387603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.398441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 180/356] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:23.398441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.495604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2914ce-f62f-434b-aae2-6fecd38c0120 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.541597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf49df2-d2a6-468d-9f1c-cb76b2e0462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.542251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf49df2-d2a6-468d-9f1c-cb76b2e0462e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.542536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf49df2-d2a6-468d-9f1c-cb76b2e0462e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.542813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf49df2-d2a6-468d-9f1c-cb76b2e0462e None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.543218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d7f5-e75d-4fd2-9675-d359bbb28955 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.546258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.552523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf49df2-d2a6-468d-9f1c-cb76b2e0462e None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.554081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf49df2-d2a6-468d-9f1c-cb76b2e0462e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.557690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 177/357] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:23.560199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.560483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.560755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.582761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:23.585045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:23.589878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e7d2-6962-4450-ad2b-4001a55e9fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.590508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e7d2-6962-4450-ad2b-4001a55e9fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.590788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e7d2-6962-4450-ad2b-4001a55e9fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.591058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e7d2-6962-4450-ad2b-4001a55e9fe0 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.592488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e7d2-6962-4450-ad2b-4001a55e9fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.593933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e7d2-6962-4450-ad2b-4001a55e9fe0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.595865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 181/358] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:23.597039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339dfd7-7253-43e0-9a92-d1f6a433707b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.597366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339dfd7-7253-43e0-9a92-d1f6a433707b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.597583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339dfd7-7253-43e0-9a92-d1f6a433707b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.599449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 182/359] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:23.600330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339dfd7-7253-43e0-9a92-d1f6a433707b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.627986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.669817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 178/360] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:23.671035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.728782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339dfd7-7253-43e0-9a92-d1f6a433707b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.782648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142838a8-448b-4dca-a15d-19dbefefbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.783267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142838a8-448b-4dca-a15d-19dbefefbf83 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.783548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142838a8-448b-4dca-a15d-19dbefefbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.783881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142838a8-448b-4dca-a15d-19dbefefbf83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.819246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c6148-08fd-4a1d-84b0-704f4d4299cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:23.853708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:23.869540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:23.869833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:23.870034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:23.870206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142838a8-448b-4dca-a15d-19dbefefbf83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.870312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:23.871034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:23.871336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:23.871675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142838a8-448b-4dca-a15d-19dbefefbf83 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.872819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:23.882341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 179/361] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:23.882341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:23.898379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.003272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 183/362] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:24.004382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.004678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.005526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.009830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1af2b-0ab1-4d80-9d36-81320387a0f3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.025224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:24.026452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:24.050187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.051473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.051473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.051473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.052589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.054033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:24.055614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 180/363] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:23 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:24.056425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.124611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 184/364] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:24.125289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.138806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.195691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.196447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832245f0-7fbd-440e-a7ad-0a9c8871c079 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.243306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.244145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.244526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.244898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.260164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:24.261076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c00692-352d-432d-8ce2-680cae30b1a6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:24.266855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:24.267862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 181/365] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:24.272732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.312244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.312891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.313173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.313448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.315436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.320323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:24.325683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 185/366] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:24.325683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.394719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627985bd-6e37-45d7-a6db-35f9de3a7201 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.418643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.436191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.437072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.437516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.437932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.439312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:24.439774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.442069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:24.449565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 182/367] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:24.450673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.462440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d252c-d7a8-4bd3-9a61-d80325a8b713 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.481157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.509597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.510503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.510726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.511002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.512193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:24.512193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.513482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:24.529550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 186/368] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:24.529550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.599296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586484f6-e635-4d14-9c28-ceeb8fac9ef4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.647741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.648453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.648795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.649387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.651181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.652665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:24.654837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 183/369] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:24.659734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.675793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d6e4-c805-4eb8-ae6e-22703a740f7b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.714772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.715446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.715728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.716026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.728980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:24.732310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:24.734403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:24.735253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:24.736079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 187/370] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:24.736718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.777379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:24.789281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8158-146f-4a65-bde5-174b93bb977f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.828316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.829346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.829905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.830379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.854717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236155bc-931d-492d-97e6-4b6b7daea7f6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:24.892495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:24.893110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:24.893391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:24.893665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:24.894497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:24.894812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.897428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:24.903501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 188/371] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:24.904690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:24.925174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:24.932678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.032417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:25.037722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d547d-4540-4e34-822e-06b7687df999 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:25.085259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:25.101073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:25.101720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:25.102426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:25.102710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:25.103643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:25.103986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:25.105357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.122240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 189/372] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:25.127279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:25.173417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 184/373] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:25.180316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:25.293145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c6065-d73e-4c55-b7fa-57f856297c2b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:25.357218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:25.358161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:25.359412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:25.360529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:25.377859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48290-68d8-4397-89f5-e8fcea40f9a0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:25.418320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:25.442714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:25.443364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:25.443639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:25.443912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:25.446473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:25.448078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.449709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 185/374] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:25 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:25.455712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:25.476841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:25.478541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.497055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:25.637654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 190/375] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:07:25.643281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:25.657869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f926a-86a9-46ba-8314-c550a4a7c317 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:25.701787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:25.702423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:25.702699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:25.702969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:25.704113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:25.706212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.707822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 186/376] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:25 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:25.714918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:25.776110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:25.851626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f1f7-27dc-4144-b1bb-a1bf36a58928 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:25.879356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:25.894341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ec493-aff9-4281-9436-0f46f10a3820 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:25.907670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:25.908701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:25.909249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:25.909758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] PATH_INFO: `/v3/projects/3648060d3e5b42e78dece5e6598cf094` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:25.914467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] RBAC: Authorizing `identity:get_project(project_id=3648060d3e5b42e78dece5e6598cf094)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:25.916208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.918389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 191/377] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:25 2022] GET /identity/v3/projects/3648060d3e5b42e78dece5e6598cf094 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:25.923509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:25.935994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:25.935994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:25.935994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:25.935994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:25.936338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:25.936338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:25.936984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c890d42-2f40-441e-b22b-85a58ff61304 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:25.948172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 187/378] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:25 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:26.029522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e68c-e0b1-4a3f-be62-f7ed65bda9a2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.029866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e68c-e0b1-4a3f-be62-f7ed65bda9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.030090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e68c-e0b1-4a3f-be62-f7ed65bda9a2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.031803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 188/379] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:26.044705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.045083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.045273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.069413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:26.070936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:26.084246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a13a9-6fdb-4e97-8d23-21b5c1296c7b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:26.139542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:26.146775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:26.147358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.147781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.148185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] PATH_INFO: `/v3/groups/bc1759315c944b0bae60ffc0be957f56` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.149024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 189/380] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:26.160182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] RBAC: Authorizing `identity:get_group(group_id=bc1759315c944b0bae60ffc0be957f56)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:26.162316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:26.164038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 192/381] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:25 2022] GET /identity/v3/groups/bc1759315c944b0bae60ffc0be957f56 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:26.169997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:26.258072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:26.283361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc3d4d-133c-4c39-a9a3-ed64dd6a7125 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:26.323152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:26.323777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.324093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.324371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.325109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] RBAC: Adding query filter params (group.id=bc1759315c944b0bae60ffc0be957f56, role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=3648060d3e5b42e78dece5e6598cf094) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:26.325421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:26.326869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:26.333056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 190/382] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:26 2022] GET /identity/v3/role_assignments?group.id=bc1759315c944b0bae60ffc0be957f56&scope.project.id=3648060d3e5b42e78dece5e6598cf094&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:26.495569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:26.635607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000a79-1ec8-4d37-9e43-4a3f69a4e74c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:26.674603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:26.675246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.675529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.675804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.686066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:26.691285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:26.692205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:26.693005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 193/383] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:26.698642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:26.835940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64873492-b424-4f8a-8ad3-25d7b128d607 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:26.872432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:26.873053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.873340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.873616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.874292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:26.874599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:26.876000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cd4a4-5cc1-4818-9594-aaa934aadefe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:26.889921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 191/384] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:26.891984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:26.925446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c93b19-f356-404b-8963-02841e557053 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.926157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c93b19-f356-404b-8963-02841e557053 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.926669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c93b19-f356-404b-8963-02841e557053 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.928633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 192/385] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:26.937873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:26.938460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:26.938934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:26.976496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:26.977303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:26.978102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:26.980260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:27.032591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080306-6fbf-4ee9-ac7c-9faf521d1e02 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:27.072295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:27.073420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.073713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.073988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.075110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:27.076620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:27.083199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 194/386] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:26 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:27.084445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:27.169415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 193/387] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:27.196220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987e88-ff41-47d1-8444-bccdcd7151e1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:27.220231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:27.232511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:27.233151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.233439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.233715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.234855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:27.236328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:27.243310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 195/388] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:27 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:27.244664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:27.350163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dc255-79d1-4a20-9263-8852a414c46d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:27.385126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:27.385800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.386087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.386366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/groups/bb01863c81ab49309728dd4fa295d79c/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.388361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] RBAC: Authorizing `identity:create_grant(project_id=53e7bf2b50344d62823af7a10bf55d7b, group_id=bb01863c81ab49309728dd4fa295d79c, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:27.389814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:27.412015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:27.417634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 194/389] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Aug 17 14:07:27 2022] PUT /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/groups/bb01863c81ab49309728dd4fa295d79c/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:27.462375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:27.592330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334af5f-030a-42be-bbfc-45a5549e4254 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:27.629103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcf78e-21ab-4378-a226-ec5ffe625abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:27.630262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcf78e-21ab-4378-a226-ec5ffe625abd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.630543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcf78e-21ab-4378-a226-ec5ffe625abd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.630815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcf78e-21ab-4378-a226-ec5ffe625abd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.641432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcf78e-21ab-4378-a226-ec5ffe625abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-40bcf78e-21ab-4378-a226-ec5ffe625abd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:27.646724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:27.647567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:27.648388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 196/390] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:27.653687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:27.774828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb559a1-b352-47b4-b73f-9e0da6ebc81b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:27.802862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d5852-0b3a-4286-b825-3ee7c13acf25 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.803493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d5852-0b3a-4286-b825-3ee7c13acf25 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.803996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d5852-0b3a-4286-b825-3ee7c13acf25 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.805757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 197/391] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:27.810868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.811398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.811873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.832867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:27.833509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:27.833784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:27.834052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:27.834721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:27.835021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:27.836425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:27.843178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:27.844412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:27.850369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 195/392] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:27.855892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:27.941895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:27.974619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:27.994748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 198/393] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:28.020997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331d23-5cd9-41c9-a526-e938d9155da6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:28.063100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:28.063744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.064045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.064316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.068639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:28.070468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:28.072386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 196/394] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:27 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:28.077507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:28.223762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b464-2adb-488c-8e33-d87a7bace443 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:28.274605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:28.275168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.275448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.275719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.276884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:28.278317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:28.280272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 199/395] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:28 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:28.286658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:28.378590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:28.443156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:28.445642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a22-9e9f-470a-99fb-1d6cc233d3fe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:28.480936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:28.493253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60103a5-5921-403e-abe4-c9798e4fadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:28.493923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60103a5-5921-403e-abe4-c9798e4fadda None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.494472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60103a5-5921-403e-abe4-c9798e4fadda None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.494753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60103a5-5921-403e-abe4-c9798e4fadda None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/groups/bb01863c81ab49309728dd4fa295d79c/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.497870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60103a5-5921-403e-abe4-c9798e4fadda None admin] RBAC: Authorizing `identity:create_grant(project_id=53e7bf2b50344d62823af7a10bf55d7b, group_id=bb01863c81ab49309728dd4fa295d79c, role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:28.500028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60103a5-5921-403e-abe4-c9798e4fadda None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:28.504020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7dd88-5f09-42c2-91fd-281d2b588d44 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:28.517422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 197/396] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Aug 17 14:07:28 2022] PUT /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b/groups/bb01863c81ab49309728dd4fa295d79c/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:28.521474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e08975-f6a0-4a27-bfcb-5492affe0c3f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.521758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e08975-f6a0-4a27-bfcb-5492affe0c3f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.522031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e08975-f6a0-4a27-bfcb-5492affe0c3f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.523774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 198/397] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:28.533633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639a01-947a-411b-a55a-e1ea7f809c39 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.533931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639a01-947a-411b-a55a-e1ea7f809c39 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.534276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639a01-947a-411b-a55a-e1ea7f809c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.564943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40683-1228-4e86-9015-087db8c37880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:28.565848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40683-1228-4e86-9015-087db8c37880 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.566276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40683-1228-4e86-9015-087db8c37880 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.566719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40683-1228-4e86-9015-087db8c37880 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.573791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ba639a01-947a-411b-a55a-e1ea7f809c39 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:28.578452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ba639a01-947a-411b-a55a-e1ea7f809c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:28.592839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40683-1228-4e86-9015-087db8c37880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-add40683-1228-4e86-9015-087db8c37880 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:28.598044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:28.599777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:28.600657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:28.606317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 200/398] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:28.610706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40683-1228-4e86-9015-087db8c37880 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:28.711164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 199/399] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:28.712974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6052a-d82b-4c95-9180-9e3fafa8cff7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.713265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6052a-d82b-4c95-9180-9e3fafa8cff7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.713541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6052a-d82b-4c95-9180-9e3fafa8cff7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.715050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 200/400] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:28.720279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.720717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.721002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.743632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:28.745283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:28.763559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40683-1228-4e86-9015-087db8c37880 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:28.776208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:28.809528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:28.810364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.810791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.812156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.812982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:28.815134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:28.816793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:28.837624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 201/401] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:28.842388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:28.856201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 201/402] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:28.948405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68ede-92cf-4a09-9f9c-ec1a1678b84b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:28.981626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:28.982502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:28.982929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:28.983344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:28.984645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:28.986469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:28.988629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 202/403] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:28 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:28.997018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.059736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:29.115908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.118876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d05e3-597e-49d9-8909-d6e301994b4d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.155976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.156684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.156969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.157241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.158371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:29.159820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:29.161436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:29.163406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 202/404] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:28 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:29.169183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.228280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93841f69-066a-4682-ae6e-c5c83a7e7cc0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.271164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.272245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.272849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.273945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.302069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:29.307242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:29.308120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:29.308914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:29.313706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 203/405] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:29.321115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.362745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28590e01-58b8-4ae6-ab59-35a8531ce5b8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.386874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:29.411982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.413018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.413706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.414078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/groups/bb01863c81ab49309728dd4fa295d79c/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.416389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] RBAC: Authorizing `identity:create_grant(project_id=715d4405cd84421196c7c0ddcfbde5a7, group_id=bb01863c81ab49309728dd4fa295d79c, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:29.418602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:29.439734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 203/406] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Aug 17 14:07:29 2022] PUT /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/groups/bb01863c81ab49309728dd4fa295d79c/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:29.440732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.453313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:29.457551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc458d-d2a1-4b29-98a9-772d34cb37be None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.508765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.509827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.510310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.510895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.511866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:29.512413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:29.514139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:29.526536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 204/407] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:29.532990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.641652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178bfa7-1536-463f-bee8-4e45032dba54 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.696701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.697988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.698720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.699611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.705773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b117f-8d55-47be-90f5-1eb9fee3ac89 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.714616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:29.722732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:29.728820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:29.729607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 204/408] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:29.731059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.793535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:29.806266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e3094-eccd-4265-90dd-e75d3d9bf7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.807418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e3094-eccd-4265-90dd-e75d3d9bf7ae None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.807742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e3094-eccd-4265-90dd-e75d3d9bf7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.808203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e3094-eccd-4265-90dd-e75d3d9bf7ae None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.809886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e3094-eccd-4265-90dd-e75d3d9bf7ae None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:29.812143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e3094-eccd-4265-90dd-e75d3d9bf7ae None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:29.819180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 205/409] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:29 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:29.821047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28634-328c-4866-a59b-44bf66d07b26 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.821335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28634-328c-4866-a59b-44bf66d07b26 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.821607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28634-328c-4866-a59b-44bf66d07b26 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.823230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 206/410] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:29.824084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28634-328c-4866-a59b-44bf66d07b26 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:29.870469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:29.877390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260b3fa-3588-4888-a3e5-959900f829a2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:29.915385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:29.916284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.916753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.917205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.918012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:29.918456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:29.920058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484982dc-3bac-4b1b-91a9-be16de556a38 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:29.929166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 205/411] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:29.934991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:29.935465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:29.935884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:29.954780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:29.956209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:29.969557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28634-328c-4866-a59b-44bf66d07b26 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.016985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.017620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.017899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.018171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.019808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:30.022208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:30.028138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 207/412] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:29 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:30.028138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.041662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 206/413] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:30.048660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.081286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:30.157029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859fc4c-c231-48d9-9d06-a9c602dc9ea4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.193510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.194099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.194379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.194715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/groups/bb01863c81ab49309728dd4fa295d79c/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.201363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] RBAC: Authorizing `identity:create_grant(project_id=715d4405cd84421196c7c0ddcfbde5a7, group_id=bb01863c81ab49309728dd4fa295d79c, role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:30.201363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:30.216806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 207/414] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Aug 17 14:07:30 2022] PUT /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7/groups/bb01863c81ab49309728dd4fa295d79c/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:30.230308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:30.237031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86efd5-c342-4198-a9b0-853ed7b7454d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.284358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.285017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.285368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.285679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] PATH_INFO: `/v3/groups/bc1759315c944b0bae60ffc0be957f56` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.289032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] RBAC: Authorizing `identity:get_group(group_id=bc1759315c944b0bae60ffc0be957f56)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:30.290555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:30.292319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 208/415] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:30 2022] GET /identity/v3/groups/bc1759315c944b0bae60ffc0be957f56 => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:30.298038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.367694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.418317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:30.433569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13944c-cf31-4df1-ae45-c87b45616556 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.473954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.474900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.475030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.475280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] PATH_INFO: `/v3/projects/3648060d3e5b42e78dece5e6598cf094` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.476509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] RBAC: Authorizing `identity:get_project(project_id=3648060d3e5b42e78dece5e6598cf094)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:30.478182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:30.480245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 208/416] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:30 2022] GET /identity/v3/projects/3648060d3e5b42e78dece5e6598cf094 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:30.484586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be7e9-e6bc-4acc-9564-61f735811ba5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.485617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.525210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.526257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.526731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.527195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.550439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:30.556381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:30.557219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:30.557996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:30.565820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 209/417] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:30.572428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.606308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc4c1-5919-40ea-820a-b2af3c0aed75 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.617974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:30.649376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb069ee-f74e-4771-a5db-c6817ea09aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.651208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb069ee-f74e-4771-a5db-c6817ea09aab None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.651629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb069ee-f74e-4771-a5db-c6817ea09aab None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.652142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb069ee-f74e-4771-a5db-c6817ea09aab None admin] PATH_INFO: `/v3/projects/3648060d3e5b42e78dece5e6598cf094/groups/bc1759315c944b0bae60ffc0be957f56/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.654246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb069ee-f74e-4771-a5db-c6817ea09aab None admin] RBAC: Authorizing `identity:create_grant(project_id=3648060d3e5b42e78dece5e6598cf094, group_id=bc1759315c944b0bae60ffc0be957f56, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:30.655826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb069ee-f74e-4771-a5db-c6817ea09aab None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:30.673028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 209/418] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Aug 17 14:07:30 2022] PUT /identity/v3/projects/3648060d3e5b42e78dece5e6598cf094/groups/bc1759315c944b0bae60ffc0be957f56/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:30.674733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0cb1-8b01-435e-8773-9fdd9908727e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.675826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0cb1-8b01-435e-8773-9fdd9908727e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.676347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0cb1-8b01-435e-8773-9fdd9908727e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.678744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 210/419] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:30.684652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.685566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.686577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.713876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:30.716107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:30.733869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83fb9-f56e-4d1a-b2b1-2d34968fce00 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.740360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:30.775714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.777019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.777019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.777210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:30.777975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:30.778352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:30.779885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:30.789781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 210/420] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:30.795244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:30.822738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 211/421] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:30.922246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:30.939979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ba05-b145-4cee-a3a9-7a030d820c92 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:30.976519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:30.977186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:30.977474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:30.977753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:31.063896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:31.065432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:31.151442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:31.180923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:31.199228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 211/422] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:31.205673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:31.312764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524079-9bee-41e2-88cd-ac2aa539e17c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:31.354669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:31.355262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:31.355545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:31.355814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:31.366992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:31.372702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:31.373625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:31.374458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 212/423] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:31.384991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:31.393805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148310-2ca4-43a1-931c-ea9203452226 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:31.400319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:31.436008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:31.436999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:31.437492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:31.438056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:31.440078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:31.442256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:31.444418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 212/424] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:31 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:31.453209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:31.552616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:31.571715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567f54-3aa7-473b-a397-8798fc74edd3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:31.639932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349179e-4de0-44fc-a26a-ebcc311b8b2b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:31.642687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:31.643307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:31.643588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:31.643862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:31.644567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:31.644922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:31.652545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:31.664731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 213/425] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:31.670781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:31.713836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035173f1-9127-4535-832c-f798f401a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:31.714498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035173f1-9127-4535-832c-f798f401a988 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:31.714782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035173f1-9127-4535-832c-f798f401a988 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:31.715058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035173f1-9127-4535-832c-f798f401a988 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:31.716423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035173f1-9127-4535-832c-f798f401a988 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:31.717914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035173f1-9127-4535-832c-f798f401a988 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:31.723940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 213/426] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:31 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:31.733099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035173f1-9127-4535-832c-f798f401a988 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:31.780703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:31.819322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b74de0-1a96-43f2-ab50-04d7db676d5f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:31.857589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:31.858245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:31.858528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:31.858801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:31.930239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035173f1-9127-4535-832c-f798f401a988 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:31.974931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:31.976762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:31.991160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:32.014350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:32.014972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.015253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.015592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.016373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:32.016685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:32.018240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9f70b-eadd-4c16-8756-ee9c335c2b37 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:32.024793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 214/427] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:31 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 611 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:32.025946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb4a2e-1125-4823-95fb-35c6442f8312 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.026230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb4a2e-1125-4823-95fb-35c6442f8312 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.026512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb4a2e-1125-4823-95fb-35c6442f8312 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.031875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 215/428] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:32.033354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.033647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.033922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.054008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:32.055415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:32.064686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:32.109414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 214/429] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:32.118079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:32.218146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 216/430] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:32.277235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621692f-79e1-4550-9adc-eb942a6c993a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:32.313702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:32.314427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.314744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.315024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] PATH_INFO: `/v3/projects/53e7bf2b50344d62823af7a10bf55d7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.316234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] RBAC: Authorizing `identity:get_project(project_id=53e7bf2b50344d62823af7a10bf55d7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:32.318272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:32.320486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 215/431] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:32 2022] GET /identity/v3/projects/53e7bf2b50344d62823af7a10bf55d7b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:32.325866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:32.449500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84c492-b733-41b8-aedb-16d87d724443 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:32.467668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:32.490788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:32.491352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.491631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.491907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.493045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:32.494651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:32.496843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 217/432] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:32 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:32.502367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:32.512397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:32.551539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:32.621704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269844c-6f1d-4852-a930-16e321c07345 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:32.631762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f648dd-4a7a-410e-899f-b1886adbcc6e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:32.657790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:32.658407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.658688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.658963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.669997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:32.670496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:32.671238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.671691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.672152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.673037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=53e7bf2b50344d62823af7a10bf55d7b) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:32.673491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:32.675083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaafad-d912-464f-81b7-378cb939ea65 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:32.675208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:32.676788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:32.677673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 218/433] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:32.682592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:32.685831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 216/434] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:32 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=53e7bf2b50344d62823af7a10bf55d7b&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:32.737731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:32.746108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280851e0-79c0-4575-b8cf-2545b5d89071 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.746621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280851e0-79c0-4575-b8cf-2545b5d89071 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.747088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280851e0-79c0-4575-b8cf-2545b5d89071 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.749016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 217/435] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:32.754659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878658-9052-4970-bb89-4ce7a25c0bc7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.755313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878658-9052-4970-bb89-4ce7a25c0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.755776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878658-9052-4970-bb89-4ce7a25c0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.795457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-05878658-9052-4970-bb89-4ce7a25c0bc7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:32.796968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-05878658-9052-4970-bb89-4ce7a25c0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:32.799682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a2641-2be0-4074-aa48-171c0536e408 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:32.837640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:32.838258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:32.838541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:32.838814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:32.839496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:32.839802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:32.841254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:32.852312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 219/436] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:32.857754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:32.901265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 218/437] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:32.967475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fa05-3f2f-4ae5-bcd5-9d495bd79cac None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:32.976876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.011013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.011546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.011823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.012137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.091008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.091674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aead35-1adb-40e2-a3e9-8fe0db24ee09 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.092002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aead35-1adb-40e2-a3e9-8fe0db24ee09 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.092277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aead35-1adb-40e2-a3e9-8fe0db24ee09 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.092583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.093748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 219/438] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:07:33.099783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.100079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.101159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.126214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:33.130454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:33.160812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.213415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 220/439] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:33.214103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.221394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 220/440] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:33.222288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.224132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.325244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038045db-41b9-4738-b377-61f813d319e6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.328699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079e59-716b-49fd-847e-9d6dcdd15153 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.361419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.362468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.362599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.363073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.363175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.363339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.364149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.364349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.365265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.366709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.368344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 221/441] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:33.373615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.375250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:33.381143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:33.382004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:33.382920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:33.384252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 221/442] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:33.389630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.405998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.467348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.489050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6f69-18c1-4efc-9bbc-04088e331ee2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.510066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97d502-f139-4975-b452-6266bbb31df5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.523265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.523903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.524212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.524487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.525606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.527041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.528640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 222/443] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:33.529412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.546446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.547047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.547348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.547715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.548727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:33.549030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.550389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.558483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 222/444] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:33.559301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.623778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.630038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839abc4-57bd-41c9-b50b-212a7ffd9b82 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.656236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0a05b-17dc-4671-9ce6-b5b86c5e6f1a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.663136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.663758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.664068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.664338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.674254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:33.680234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:33.681211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 223/445] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:33.684812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.685557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.692548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.693153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.693433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.693708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.694435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=cd1209cf9c93469fab17d5f0e1fea91e, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:33.694993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.696476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.701982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 223/446] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=cd1209cf9c93469fab17d5f0e1fea91e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:33.702738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.805982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347681a-9aeb-457d-a011-c74657e239bf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.823153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bd6bc-6db2-4a27-8ccc-11501e81ad77 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:33.843548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.844085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.845064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.845064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.864844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:33.866008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:33.866637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:33.866928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:33.867937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:33.869801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.869801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.875593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:33.878651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 224/447] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:33.884565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:33.928793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:33.930362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:33.948047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:34.001919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f852bd-2250-4dcc-8288-74b4810b29e2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.039645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.040401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.040573 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.040847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.055545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 224/448] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:34.061380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:34.111566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.113073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.117283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:34.160174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b97c-8d50-45bb-8c67-f10426b632fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.164871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:34.194961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.195597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.195877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.196179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] PATH_INFO: `/v3/projects/715d4405cd84421196c7c0ddcfbde5a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.197294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] RBAC: Authorizing `identity:get_project(project_id=715d4405cd84421196c7c0ddcfbde5a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.198740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.200384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 225/449] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:34 2022] GET /identity/v3/projects/715d4405cd84421196c7c0ddcfbde5a7 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:34.205765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:34.212221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 225/450] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:07:34.217883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:34.302552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3eab2-4b47-4231-9cd2-8c2039fb86e2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.315270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0155fa-8581-4843-83f5-652a4bb43165 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.325414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:34.336572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.337195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.337473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.337745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] PATH_INFO: `/v3/groups/bb01863c81ab49309728dd4fa295d79c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.338831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] RBAC: Authorizing `identity:get_group(group_id=bb01863c81ab49309728dd4fa295d79c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.340308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.342141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 226/451] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:34 2022] GET /identity/v3/groups/bb01863c81ab49309728dd4fa295d79c => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:34.348321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:34.350098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.350727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.351007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.351280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] PATH_INFO: `/v3/projects/3648060d3e5b42e78dece5e6598cf094` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.352490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] RBAC: Authorizing `identity:get_project(project_id=3648060d3e5b42e78dece5e6598cf094)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.353931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.355598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 226/452] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:07:34 2022] GET /identity/v3/projects/3648060d3e5b42e78dece5e6598cf094 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:34.360868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:34.384259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:34.446162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf5de4-a5b2-4714-9473-b0a081f2111d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.459684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58e846-d73b-43e1-a2e3-366db592996c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.480090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.480696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.480980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.481256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.481984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] RBAC: Adding query filter params (group.id=bb01863c81ab49309728dd4fa295d79c, role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=715d4405cd84421196c7c0ddcfbde5a7) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:34.482290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.483737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.489603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 227/453] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:34 2022] GET /identity/v3/role_assignments?group.id=bb01863c81ab49309728dd4fa295d79c&scope.project.id=715d4405cd84421196c7c0ddcfbde5a7&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:34.491186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78d7b-d429-4bc7-8862-7bb1e67e74d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.491808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78d7b-d429-4bc7-8862-7bb1e67e74d5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.492113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78d7b-d429-4bc7-8862-7bb1e67e74d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.492385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78d7b-d429-4bc7-8862-7bb1e67e74d5 None admin] PATH_INFO: `/v3/groups/bc1759315c944b0bae60ffc0be957f56` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.493506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78d7b-d429-4bc7-8862-7bb1e67e74d5 None admin] RBAC: Authorizing `identity:get_group(group_id=bc1759315c944b0bae60ffc0be957f56)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.494947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78d7b-d429-4bc7-8862-7bb1e67e74d5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.496583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 227/454] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Aug 17 14:07:34 2022] GET /identity/v3/groups/bc1759315c944b0bae60ffc0be957f56 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:34.502900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:34.565128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:34.611311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4096888-14eb-4fdd-9f0b-2b874d68ae95 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:34.647350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:34.648011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:34.648323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:34.648598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:34.649328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] RBAC: Adding query filter params (group.id=bc1759315c944b0bae60ffc0be957f56, role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=3648060d3e5b42e78dece5e6598cf094) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:34.649636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:34.651074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f212b-6c22-48cb-8c3c-12228b527e74 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:34.656824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 228/455] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Aug 17 14:07:34 2022] GET /identity/v3/role_assignments?group.id=bc1759315c944b0bae60ffc0be957f56&scope.project.id=3648060d3e5b42e78dece5e6598cf094&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:36.962024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429723e-0a53-4505-8ac1-80befe8708be None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:36.962525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429723e-0a53-4505-8ac1-80befe8708be None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:36.962599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429723e-0a53-4505-8ac1-80befe8708be None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:36.964137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 228/456] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:36.969875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:36.970295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:36.970474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:36.990837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:36.992053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:37.065597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c30a-db84-4f58-9394-d060590bf4af None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.066211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c30a-db84-4f58-9394-d060590bf4af None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.066728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c30a-db84-4f58-9394-d060590bf4af None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.068533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 229/457] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:37.074210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7b88-c7db-4ff8-99fa-c2164be4368c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.074485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7b88-c7db-4ff8-99fa-c2164be4368c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.075001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7b88-c7db-4ff8-99fa-c2164be4368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.076863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 229/458] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:37.107348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0e5a7b88-c7db-4ff8-99fa-c2164be4368c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:37.109354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0e5a7b88-c7db-4ff8-99fa-c2164be4368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:37.218253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 230/459] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:37.438308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:37.502117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:37.509622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fba7d-3f95-4ab5-966c-22f560209d52 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.510196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fba7d-3f95-4ab5-966c-22f560209d52 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.510673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fba7d-3f95-4ab5-966c-22f560209d52 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.512465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 231/460] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:37.517710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.518208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.518680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.545734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:37.547272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:37.560469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d97d6-d8a8-4f1b-bdfa-2b7238a5adbc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:37.562497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:37.599039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:37.599677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.599967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.600270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.610392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:37.612042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:37.624361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 232/461] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:37.625350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-821334a1-5c49-4862-9c42-92d27c30f2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:37.633363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:37.634471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:37.635521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:37.635521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:37.635521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:37.635521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 230/462] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:37.636101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1b3a-b7d2-4b5a-96da-359c86880b0a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.636388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1b3a-b7d2-4b5a-96da-359c86880b0a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.636660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1b3a-b7d2-4b5a-96da-359c86880b0a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.641728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 231/463] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:37.643067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1b3a-b7d2-4b5a-96da-359c86880b0a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:37.750452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1b3a-b7d2-4b5a-96da-359c86880b0a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:37.750704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91617-298d-4c7d-88fa-f2316c53a4ef None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:37.752444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:37.787661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:37.788802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.789305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.789615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:37.789924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.790607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.790722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:37.791119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.791241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:37.791631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.792816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ca8d-9509-4af7-90dd-00f1e4efef30 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:37.803158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:37.804857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:37.811295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 232/464] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:37.812979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:37.813499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:37.813973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:37.821840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:37.822777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:37.823614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:37.823614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:37.823614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:37.830333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 233/465] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:37.831352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:37.833996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:37.834543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:37.835329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:37.909463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 233/466] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:37.910812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:37.955597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbef6-d900-400c-b0dd-c9fbc3b01158 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.006281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.007813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.008403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.008687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.012299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.014629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.015471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:38.025197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc9f2c-39c0-484b-9af9-f50ea306df2f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.045828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 234/467] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:37 2022] POST /identity/v3/users => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:38.046844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.065409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.066895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.067389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.067845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.068733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:38.069256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.070990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.084462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 234/468] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:38.091185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.170435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:38.208706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ec1e-9d28-4791-a44b-681b4c250fb2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.239627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16006cde-a091-4999-a826-3d26a16c4df9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.244988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.245622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.245895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.246161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.246804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.249257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.273052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 235/469] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:38 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:07:38.273806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.284396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.285681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.286020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.286298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.291241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:38.307126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.310567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:38.333544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:38.334506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:38.335350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:38.335350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:38.335350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:38.338180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 235/470] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:38.345413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.430458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d216-ef36-4c22-ae68-d0b55d3869b2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.470941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efede9ef-4bec-47ba-8ed1-6e6b817b3be9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.479308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.480364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.480364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.480563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.483880 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:38.499892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.502124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.515488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.516832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.517127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.517410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.518068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:38.518383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.520339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:38.520619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:38.521443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:38.522257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:38.522257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:38.522257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:38.522257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 236/471] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:38.528139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.539511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 236/472] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:38.545424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.605477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:38.660253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fc818-7d46-403b-8c1d-0f96a8a5f89f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.675253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca453-a4c2-4de2-a0f5-b6e256dbc88a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.704389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.705056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.705341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.705616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.706421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:38.706866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.708380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.720708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931f95f-9614-4764-a488-61622614369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.721319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f95f-9614-4764-a488-61622614369b None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.721596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f95f-9614-4764-a488-61622614369b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.721864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f95f-9614-4764-a488-61622614369b None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.722529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931f95f-9614-4764-a488-61622614369b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.723987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931f95f-9614-4764-a488-61622614369b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.731410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 237/473] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:38.747997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:38.770807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 237/474] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:38 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:07:38.857093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf8ea-481f-406e-ae65-2f3688410c21 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.857385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf8ea-481f-406e-ae65-2f3688410c21 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.857566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf8ea-481f-406e-ae65-2f3688410c21 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.859130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 238/475] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:38.867729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.868063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.868295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.875282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215bd4c-2407-4e4a-af16-9deca2acbb07 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:38.904361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:38.913430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:38.914742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:38.919822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:38.920919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:38.921579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:38.922086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:38.922928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:38.925791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:38.953927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 238/476] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:38 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:38.973887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:39.023767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 239/477] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:39.312973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:39.434126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f7224-faea-4cf7-847c-c7f0efbdc091 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:39.477218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:39.477838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:39.478273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:39.478554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:39.479221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:39.480638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:39.494222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.sql.core [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 14:07:39.494222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 14:07:39.494222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [parameters: {'id': 'd9e3e0c0b2914b1ea7464384161a5257', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 14:07:39.494222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 17 14:07:39.511122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:07:39.512047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application yield resource Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise self.value Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application session.commit() Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 14:07:39.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.flush() Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application compat.raise_( Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 14:07:39.513880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:07:39.515357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:07:39.517365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [parameters: {'id': 'd9e3e0c0b2914b1ea7464384161a5257', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:39.519350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 14:07:39.521299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:39.528633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 239/478] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Aug 17 14:07:39 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:39.528791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:39.646412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7a42-1892-4493-bf75-624ebeabd9e3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:39.687781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59466b0-52df-4099-8ca0-3caeef2c2605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:39.688450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59466b0-52df-4099-8ca0-3caeef2c2605 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:39.688735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59466b0-52df-4099-8ca0-3caeef2c2605 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:39.689056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59466b0-52df-4099-8ca0-3caeef2c2605 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:39.703761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59466b0-52df-4099-8ca0-3caeef2c2605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e59466b0-52df-4099-8ca0-3caeef2c2605 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:39.712659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:39.713535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:39.714310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 240/479] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:39.721040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:39.814537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:39.892097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52dd9-56e3-412d-a20e-0211e2686f4d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:39.940763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:39.941328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:39.941612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:39.941888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:39.942563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:39.942867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:39.944290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ae05a-cf71-4a22-b3ba-bd0eddf96a22 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:39.959460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 240/480] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:40.466099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cdb0-df92-4283-b6fa-474a5997d1a4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:40.466606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cdb0-df92-4283-b6fa-474a5997d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:40.466678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cdb0-df92-4283-b6fa-474a5997d1a4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:40.468312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 241/481] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:40.473653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e157-38a8-4e6e-8e52-2129b486efb2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:40.474045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e157-38a8-4e6e-8e52-2129b486efb2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:40.474202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e157-38a8-4e6e-8e52-2129b486efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:40.492654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-93e7e157-38a8-4e6e-8e52-2129b486efb2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:40.493922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-93e7e157-38a8-4e6e-8e52-2129b486efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:40.579881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 241/482] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:40.768480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7ee2-42ba-46f3-a444-65c9c887faaf None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:40.768781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7ee2-42ba-46f3-a444-65c9c887faaf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:40.769043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7ee2-42ba-46f3-a444-65c9c887faaf None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:40.771767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 242/483] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:40.776792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:40.777081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:40.777359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:40.800047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:40.801782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:40.838769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:40.890804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 242/484] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:40.963041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b7ee2-42ba-46f3-a444-65c9c887faaf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:40.983077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:41.091799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b7ee2-42ba-46f3-a444-65c9c887faaf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.138896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:41.139529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.139809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.140107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.155915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:41.160732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:41.161609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:41.162395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 243/485] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:41.167750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.242697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.320210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde871-3ccc-4353-9d88-3089c23f606b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.370310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:41.370845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.371125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.371397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.372098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:41.372403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:41.374314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be76a48-16ad-4dfa-930f-1df5f1bf4539 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:41.376015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:41.388238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 243/486] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:41.390663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab56c-4940-457d-9a70-00c5c5f4fa57 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.391311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab56c-4940-457d-9a70-00c5c5f4fa57 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.391842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab56c-4940-457d-9a70-00c5c5f4fa57 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.398635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 244/487] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:41.398635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab56c-4940-457d-9a70-00c5c5f4fa57 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.405839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afb63f-dfd2-4940-9a2f-2b5bf9c06830 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.428215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:41.445957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f4387-2e6e-4181-8336-836d0aab777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:41.446590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f4387-2e6e-4181-8336-836d0aab777e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.446872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f4387-2e6e-4181-8336-836d0aab777e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.447850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f4387-2e6e-4181-8336-836d0aab777e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.457818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f4387-2e6e-4181-8336-836d0aab777e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f39f4387-2e6e-4181-8336-836d0aab777e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:41.462741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:41.463616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:41.464446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 244/488] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:41.470178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.470178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.470178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.485557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:41.486761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:41.541242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab56c-4940-457d-9a70-00c5c5f4fa57 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.568002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 245/489] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:41.568002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.585041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10316189-8446-42df-8932-7164e1f88753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:41.585944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10316189-8446-42df-8932-7164e1f88753 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.586234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10316189-8446-42df-8932-7164e1f88753 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.586513 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10316189-8446-42df-8932-7164e1f88753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.600226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10316189-8446-42df-8932-7164e1f88753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:41.602648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10316189-8446-42df-8932-7164e1f88753 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-10316189-8446-42df-8932-7164e1f88753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:41.622704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:41.623621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:41.624489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:41.624489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:41.624489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:41.624489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 245/490] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:41.625762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9017e-06cc-4dda-9e20-7f833c40e1a6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.626051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9017e-06cc-4dda-9e20-7f833c40e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.626879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9017e-06cc-4dda-9e20-7f833c40e1a6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.629367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 246/491] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:41.630077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9017e-06cc-4dda-9e20-7f833c40e1a6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.645457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:41.690322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b5af-72a4-41a9-9f39-1a8edad2fd90 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.735383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:41.736022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.736309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.736586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.737268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:41.737575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:41.741525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44e19c-b9ff-491c-adb0-8333f332da61 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:41.745289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:41.753695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 246/492] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:41.753695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.753695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.753695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.774505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:41.776158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:41.779518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9017e-06cc-4dda-9e20-7f833c40e1a6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.821240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:41.822163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:41.822646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:41.823118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:41.824007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:41.824544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:41.826230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:41.839983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 247/493] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:41.840808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.865173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 247/494] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:41.866971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:41.945088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:41.962717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80834dd3-d8c2-48d8-9378-bac63374cc12 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:41.992438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260b604-28eb-45d1-b835-80ee317f0ccf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.008419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.009596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.010084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.010683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.014019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.025945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.028262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.032818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.033453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.033735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.034006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.042409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.043916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:42.047697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:42.048596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:42.049405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:42.049405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:42.049405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:42.051935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:42.052965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:42.062137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:42.063064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 248/496] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:07:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:42.064598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.174842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e297e-25e1-4a39-8551-a5a6a4de52a1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.177959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030b425-a0ab-43c6-9619-6757195346e7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.198286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.215783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.216444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.216728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.217009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.219784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.220421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.220706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.220977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.221623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:42.221961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.223377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.227527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:42.232815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:42.233716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:42.234503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 249/497] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:42.235134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.245960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 249/498] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:42.245960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.289045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.341768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538ec5b-4181-44b3-97bb-4e13600ad0db None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.350302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab8be-e6a1-4aff-ae48-10bbb527ef00 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.375509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.376435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.376716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.376992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.377723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:42.378027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.379561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.386015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.386850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.387311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.387764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.399115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:42.404268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:42.405224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:42.406211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:42.409238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 250/499] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:42.409238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.417340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 250/500] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:42.418183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.451908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.525133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a92599-8afc-4000-98d9-d1a61d9130eb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.530398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9bfe-3639-4563-b2ec-74ff3ff7f94f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.538045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.560396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.560991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.561278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.561552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.562216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:42.562522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.563910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.566499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.567136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.567417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.567691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.573008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 251/501] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:42.573797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.578533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.580029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:42.593607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:42.594692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:42.595575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 251/502] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:42.596171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.670843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.674156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc3af6-73b2-40ac-a4d5-7c243a45a4d9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.697172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042a527-2fba-4edd-b19f-6cfe50750cd5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.707544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.708120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.708408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.708686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.709350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:42.709666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.711042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3caf8f-18d8-4ec5-bab0-3366e7e6d6c7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.718869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 252/503] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:42.720098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529fe4b-4e74-4a67-b0d8-89009cb44cd6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.720388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529fe4b-4e74-4a67-b0d8-89009cb44cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.720723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529fe4b-4e74-4a67-b0d8-89009cb44cd6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.722154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 253/504] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:42.723374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529fe4b-4e74-4a67-b0d8-89009cb44cd6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.732783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.733396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.733675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.733945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.767630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.802636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.804147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.828976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529fe4b-4e74-4a67-b0d8-89009cb44cd6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:42.862541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:42.863220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:42.863493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:42.863775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:42.873903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:42.875339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:42.889614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:42.890560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:42.891401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:42.891401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:42.891401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:42.891401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 254/505] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:42.891635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.905418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 252/506] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:42.906252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:42.912547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.970356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:42.990692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f672d9-ab60-4393-8682-2627c836e43c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.005257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42015b54-3e71-4e29-97c8-41f60806abae None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.023825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.024522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.024805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.025078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.025807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:43.026111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.027569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671480f-586a-42c3-b29b-692eabc24a05 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.039894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.040551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.040835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.041111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.051380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.053073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.063293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 255/507] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:43.064515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.064806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.065082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:43.067913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:43.068795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:43.069885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:43.069885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.069885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:43.069885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 253/508] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:43.070653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.086437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:43.087641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:43.154395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 256/509] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:43.155427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.157727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.170941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8912-64e4-4424-b3ea-5d3eb0a4d7ff None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.189120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.215558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.216218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.216506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.216784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.217446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:43.217743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.219145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.232350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 254/510] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:43.237253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.274924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b343e-ce12-48ac-84d3-a0ceace7899a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.312240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.312874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.313155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.313429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.324735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.326319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.341171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d2b4c-27a3-4365-86b8-f3fe6e942b96 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:43.342833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:43.343775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:43.344663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:43.344663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.344663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:43.350424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 257/511] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:43.350424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.377211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.377814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.378092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.378363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.408116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.426843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.449988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.451467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.456352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab48a3-f7a4-4ad4-879c-b86d0838f036 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.489112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.489647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.489931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.490214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.490963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:43.491268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.492685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.504540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 258/512] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:43.505348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.550464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 255/513] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:43.551177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.607764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a0578-876d-43eb-ab28-e0f1aeb72b15 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.621401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.626811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.642833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.643455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.643734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.644092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.650032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56ca5-112e-4c7d-a714-3543c05580c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.651553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.653030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:43.664116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:43.664986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:43.665860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 259/514] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:43.666420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.687442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.688077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.688356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.688625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.689263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:43.689562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.691560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.702954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 256/515] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:43.703779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.768566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949128f2-588c-4178-b892-d9eca5dc4668 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.801769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.802383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.802480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1e014-0c39-4234-bcdb-b208d440b0fd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.802661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.802931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.813050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.814493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:43.828772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:43.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:43.830771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:43.830771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.830771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:43.830771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 260/516] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:43.830771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.840198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.840831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.841106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.841373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.848849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.850326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.852025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.859761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:43.863134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:43.864081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:43.864964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 257/517] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:43.869541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:43.933596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf51a-46b5-4dc8-bd8c-901090f446f4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.966662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:43.967082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056824a-be44-44cc-a8d3-dd350336372f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:43.967288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:43.967568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:43.967839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:43.978151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:43.979608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:43.993678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:43.994739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:43.995747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:43.995747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:43.995747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:43.995747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 261/518] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:43.995747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.003270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.003921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.004229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.004501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.005237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:44.005540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.007031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.024582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 258/519] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:44.025367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.076221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.080690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.098093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa11e47-a3ff-40dd-9b8c-85551d35e161 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.123651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b8c35-9bd8-4f41-b132-842d120d44af None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.131482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.132137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.132423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.132704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.139211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.140697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:44.152292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:44.153187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:44.154184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 262/520] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:44.154756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.159360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.160608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.160964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.161314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.162033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:44.162414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.163847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.175316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 259/521] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:44.176552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.256115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4fd8-89dc-4bb9-b1ed-daa1172c60d9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.274359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54012f-bcc9-44b6-a3ab-63bf18f1e88f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.289026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.289626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.289748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.289900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.290474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.290934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:44.291327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.292934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.300879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.307698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.308341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.308621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.308892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.309533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:44.309836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.310177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 263/522] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:44.310952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.311314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.330430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 260/523] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:44.330430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.413565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bb7bf-4e38-49a5-8ff4-e1442720aa87 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.426195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3455f-5c86-4132-b2f9-af0ece8a9eb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.446525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.447116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.447398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.447664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.460915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.461519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.461799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.462071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.462766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:44.463069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.464549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.482714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:44.483476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.508710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.515522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.516813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.517024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.580395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef2c52-8261-4d41-ba74-636acc1b5990 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.614728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.615102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 264/525] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:44.615530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.615604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.615860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.616049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.616529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.617987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.655983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 262/526] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:07:44 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:07:44.655983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.723946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.731236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a03f-ce0b-4578-a046-8fe0400869fe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.762420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.770414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.771027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.771304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.771570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.773076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0b20-1a91-44f3-8fa7-d54512d9b627 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.815409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.817030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.817530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.818003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.827108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.828730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:44.843565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:44.844503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 263/527] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:44.845946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.852811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.854355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:44.949856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d64fe-75a4-4944-9588-d0ece94d71d6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:44.962183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:44.968580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 265/528] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:44.969392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:44.991419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:44.992073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:44.992358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:44.992628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:44.993368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=11ac5634282f478885ee36f51cf7ca55) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:44.993678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:44.995143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.000641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 264/529] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/role_assignments?user.id=11ac5634282f478885ee36f51cf7ca55&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:45.001419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.022669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.101399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699282-267b-4c22-b7d9-aed495108196 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.121701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651bde-601a-4b55-91a0-00f9a8cc8a1e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.139650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.140631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.141092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.141542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.154870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.157919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.161773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.162555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.162984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.163257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.164035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:45.164343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.165782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:45.176167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:45.177112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:45.178389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:45.178389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:45.178389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:45.178389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 266/530] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:45.178389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.186328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 265/531] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:45.187191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.233795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.294673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7294f-f88f-4994-b692-766362a0f262 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.302319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.328870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817169a2-4f37-42f6-81d3-ff39db8f450b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.342662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.343756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.344072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.344352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.359341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.361264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.368252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.368977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.369352 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.370184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.370999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:45.371849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.373619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:45.377672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:45.379420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:45.381240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:45.381240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:45.381240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:45.384008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 267/532] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:45.384844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.389514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 266/533] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:45.390325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.502576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.506630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9ab16-b4a2-4ffe-be05-1a8b672fa15c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.522861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500152-9b7c-43de-9e64-01bda12709f5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.551740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.552684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.553209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.553684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.554614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=3fb472deed9140dcbb47301a3871a21c) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:45.555135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.556826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.567983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.567983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.567983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.567983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.568367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:45.568367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.568367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.569144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 268/534] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/role_assignments?user.id=3fb472deed9140dcbb47301a3871a21c&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:45.570323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.570717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.584155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 267/535] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:45.592017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.738023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399b2e1-db4c-482e-8ffb-ea9f5d148de4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.775999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be35ea9-e692-4dda-a057-02b7e5f8c930 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.776517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.776732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.777014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.777286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.784419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.786416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:45.797768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:45.798772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:45.799769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 268/536] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:45.805331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.827833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.828865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.829356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.829928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.841342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.842812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.864636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:45.867714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:45.870256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:45.872282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 269/537] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:45.879310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:45.908268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12455d98-8307-42fd-a030-abdb76ce7f73 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:45.929625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:45.947076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:45.947690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:45.947982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:45.948287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:45.948982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:45.949289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:45.954324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:45.988737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 269/538] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:45.990957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:46.086252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309117a3-2115-4809-98af-89b0dcd86e56 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:46.160894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:46.161519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:46.161799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:46.162072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:46.162775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:46.163077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:46.164549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:46.165094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b616f20-413a-46cc-aaf5-80e655957ad3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:46.183900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:46.202683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:46.202683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:46.203146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 270/539] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:46.203295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:46.203295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:46.208087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=0df436d79943414185c4a6c5c6f9c5ed) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:46.208087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:46.208087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e36b6-b93b-4f63-a505-22b346f2b6ab None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:46.209500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:46.212267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 270/540] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:45 2022] GET /identity/v3/role_assignments?user.id=0df436d79943414185c4a6c5c6f9c5ed&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:46.351305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:46.367981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32581-d82e-466d-acf1-a2f779376dd2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:46.403052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:46.403661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:46.403941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:46.404237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:46.404962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=4bd62078f127457392fa0dd755ed1a86) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:46.405270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:46.406693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42700c-ca9f-4175-9e85-bf6c2f5c6d3d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:46.412540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 271/541] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:46 2022] GET /identity/v3/role_assignments?user.id=4bd62078f127457392fa0dd755ed1a86&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:46.708320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376aca3-69c8-4f18-854b-84262f822243 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:46.708611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376aca3-69c8-4f18-854b-84262f822243 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:46.708890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376aca3-69c8-4f18-854b-84262f822243 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:46.710485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 271/542] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:46.715789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528584a8-ce04-434c-ab92-423684ff6e6e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:46.716123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528584a8-ce04-434c-ab92-423684ff6e6e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:46.716401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528584a8-ce04-434c-ab92-423684ff6e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:46.745023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-528584a8-ce04-434c-ab92-423684ff6e6e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:46.746265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-528584a8-ce04-434c-ab92-423684ff6e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:46.846214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 272/543] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:47.156541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2419b4-a058-45c3-8fd3-6827e93e7859 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.157018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2419b4-a058-45c3-8fd3-6827e93e7859 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.157018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2419b4-a058-45c3-8fd3-6827e93e7859 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.158623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 272/544] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:47.163985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.164300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.164580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.188877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:47.190075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:47.274589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2419b4-a058-45c3-8fd3-6827e93e7859 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:47.282407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 273/545] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:47.428723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2419b4-a058-45c3-8fd3-6827e93e7859 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:47.466489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:47.467118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.467396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.467665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.486736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:47.491941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:47.492817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:47.493589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 273/546] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:47.498993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:47.517926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:47.656256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0484f-7f83-49b5-9408-34a8a5d92807 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:47.684547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:47.714727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:47.715343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.715622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.715894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.716588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:47.716900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:47.718289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:47.739253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 274/547] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:47.741930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:47.772330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:47.846805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:47.865386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83437fd-2f27-43b6-8bbd-f17f87b9086a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:47.881721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba776-65b2-43b0-a620-edcc90d9fae1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:47.899328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd38f6-4bb0-4ad5-908e-026d207ed31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:47.899977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd38f6-4bb0-4ad5-908e-026d207ed31f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.900257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd38f6-4bb0-4ad5-908e-026d207ed31f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.900529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd38f6-4bb0-4ad5-908e-026d207ed31f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.911031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd38f6-4bb0-4ad5-908e-026d207ed31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-45bd38f6-4bb0-4ad5-908e-026d207ed31f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:47.916334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:47.917194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:47.917968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:47.918575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:47.918575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.919314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:47.919480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.919480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.919764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175782a-2f8a-4379-a2e7-1ba7983ffe95 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.919764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175782a-2f8a-4379-a2e7-1ba7983ffe95 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.919764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175782a-2f8a-4379-a2e7-1ba7983ffe95 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.924658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 275/549] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:47.925438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175782a-2f8a-4379-a2e7-1ba7983ffe95 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:47.930699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:47.932289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-596d34e0-545f-4549-835a-67fbea6c5658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:47.948563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:47.951160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:47.953589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:47.953589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:47.953589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:47.958721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 275/550] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:47.958721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:47.958721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:47.958721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:47.975091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:47.976324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:48.028422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.032344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175782a-2f8a-4379-a2e7-1ba7983ffe95 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.051171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 276/551] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:48.052387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.085087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.085702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.086004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.086254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.086974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:48.087276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.088731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.106705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:48.109923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.112026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.162706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3323c-9a81-43e3-a2f4-006b94733802 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.200686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.201596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.202026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.202448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.203256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:48.203711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.205695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.225167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 277/553] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:48.226730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.316816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82436aee-01e2-4cc6-912d-6c5f3c3d4a32 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.345181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b17403-6d6e-4a22-8b3c-607993c57c52 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.360961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.386757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.388113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.388759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.389181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.397431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.399062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.405171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.405808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.406084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.406354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:48.411352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:48.412581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:07:48.413692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:48.420274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 278/554] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:48.421867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.435032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.436543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:48.467598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:48.468871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:48.470075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:48.470075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:48.470075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:48.470075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 277/555] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:48.473741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.512594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.565016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e3609-935f-4660-b1e8-30a5f7f17940 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.606012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d7459-8190-49d2-a287-ad6b82b7ec54 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.609563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.610181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.610466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.610744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.611487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:48.611796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.613419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.633342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 279/556] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:48.634152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.646872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.647479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.647762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.648061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.648774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:48.649079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.650465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca3608-21e9-4c62-9493-c8b09a7ad312 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.663339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 278/557] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:48.664390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ef5c-64ee-4398-84f3-30ea34cf981a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.664675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ef5c-64ee-4398-84f3-30ea34cf981a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.664947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ef5c-64ee-4398-84f3-30ea34cf981a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.666262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 279/558] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:48.670773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ef5c-64ee-4398-84f3-30ea34cf981a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.670958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.745670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d29e5-6e36-446e-b00a-d98af1e8ee52 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.746394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.774362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ef5c-64ee-4398-84f3-30ea34cf981a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.780205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.780835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.781119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.781394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.791715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:48.796476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:48.798025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:48.799094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:48.802633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 280/559] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:48.803674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:48.808841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79116669-f08c-419d-9749-f83fa4229ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.809443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79116669-f08c-419d-9749-f83fa4229ace None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.809719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79116669-f08c-419d-9749-f83fa4229ace None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.809986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79116669-f08c-419d-9749-f83fa4229ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.877620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79116669-f08c-419d-9749-f83fa4229ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.879155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79116669-f08c-419d-9749-f83fa4229ace None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.892765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.902977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e902c3-8fc5-421d-8425-e45d63fb9a9d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:48.937028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:48.937659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.937945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.938215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.945292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:48.946731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:48.950821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9a69c2f3-f345-4066-8619-2b3a8a1c7bcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:48.958682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:48.959692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:48.960647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 281/560] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:48.961233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.961233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.961579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.978627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:48.979816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:48.982221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 280/561] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:48.983458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55f93-7695-483e-bc31-4d5deca6d28f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:48.983744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55f93-7695-483e-bc31-4d5deca6d28f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:48.984055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55f93-7695-483e-bc31-4d5deca6d28f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:48.988056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 281/562] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:48.988056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba55f93-7695-483e-bc31-4d5deca6d28f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.048542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 282/563] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:49.049416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.095873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba55f93-7695-483e-bc31-4d5deca6d28f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.132784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.134721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.135783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.136390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.136887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.137650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:49.137961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.139346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.147845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 282/564] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:49.148678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.157436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623720a5-0713-42c3-b7a6-99b245507332 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.188767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.193061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.193678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.193957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.194227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.195217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:49.195521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.197411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97870e7b-cc16-46dd-92d1-65bd9d12a1b1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.216774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 283/565] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:49.218049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.218343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.218616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.236686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:49.238396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:49.276039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66775-f6be-437e-bdfd-d82c7e2b084a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.310872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 284/566] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:49.312057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.321537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.322168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.322464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.322692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.332721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.334164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:49.349367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:49.350332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:49.351205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:49.351205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:49.351205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:49.351205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 283/567] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:49.351205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.390282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.427538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61977d-a5f4-4c5e-825c-45c51aad7c80 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.445548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.457750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b6a6-28aa-4d24-ae4e-78b1bbc25994 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.468869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.469512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.469795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.470256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.483889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.485859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.491557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.492213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.492488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.492763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.503764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:49.504592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:49.505486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:49.506356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:49.506356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:49.506356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:49.506529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.506598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 285/568] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:49.507097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:49.523795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:49.524813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:49.525685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:49.525685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:49.525685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:49.525685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 284/569] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:49.530106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.611252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71a120-5dd7-41e9-9450-03accbc6f150 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.631401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.633428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753cdc-4c47-40c8-8dff-63c918bdf874 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.645378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.646018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.646301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.646577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.656350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:49.661515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:49.662456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:49.663299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 286/570] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:49.663989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.666479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.667083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.667368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.667642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.668319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:49.668623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.669987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.679258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.684234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 285/571] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:49.684924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.763293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ddaf-cbe5-4292-a75e-738c006223de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.784631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1823c7-e46c-43cf-aee1-d6667929bb75 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.795702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.796336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.796612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.796881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.797510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:49.797812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.799183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.812192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 287/572] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:49.812980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.821550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.822154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.822434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.822705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.823350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:49.823658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.825059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.837176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:49.837953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.858147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.897486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:49.914387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9d4c5-0d3d-42a0-a1f4-642c0e6b250c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.939214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467cf27-0374-496f-97a4-e8a8fbaddb19 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:49.947714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.948374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.948656 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.948929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.959474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:49.964233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:49.965136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:49.965961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:49.966681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:49.974221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:49.974804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:49.975087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:49.975358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:49.976056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:49.976363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:49.977731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:49.985864 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:49.986483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.066915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.070149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc55408-9c0f-459c-8041-8d4587f9cd84 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.089603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244790fd-8513-4b42-bb9e-ec76cc0e2d4a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.103342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.104007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.104287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.104559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.110896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.111779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.113048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:50.123892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:50.124935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:50.126221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:50.126660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.126660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.126660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.126660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.126910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:50.126910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.135170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.136651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:50.147754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:50.148871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 288/577] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:50.149952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.228313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50b276-f167-42a1-8c78-b14f28f2ebbe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.248615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ef35-70ec-41b8-8bce-41679a3e19dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.261363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.261996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.262287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.262590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.269186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.270699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.281471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:50.281623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:50.282498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:50.283383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:50.283802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.283802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.283931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 290/578] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:50.284020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.284020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:50.284156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.284745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.285500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.296081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 289/579] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:50.296081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.308192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.338876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.384369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f95045-3d3c-49d1-a642-4c90352487e5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.391425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b15-43c6-4354-ad1d-7d2f1c520792 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.417616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.418185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.418469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.418743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.424200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.425312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.425603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.425874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.426556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:50.426859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.428300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.430617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.432099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.446100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 290/580] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:50.446100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:50.446884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:50.447819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:50.448939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:50.448939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:50.448939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:50.448939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 291/581] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:50.448939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.520776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.542367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ddf70-7b57-4677-97d6-3ab1d434f12e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.544638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.549718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538800-fd6c-4dbf-a020-7c0a8bfbcfcb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.578299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.578905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.579187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.579462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.580212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:50.580518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.582473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.583702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.584337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.584619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.584893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.585579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:50.585883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.587293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.598919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 292/582] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:50.602429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 291/583] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:50.602574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.602657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.698793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec28ad-2d34-4c4c-8770-d025d63e6f16 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.699001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638f10-1bb1-447d-b18f-f85f8ae570ec None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.727569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.733186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.733794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.734078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.734350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.735083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=c3280a3468db42b29ce76accc1458f6e) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:50.735390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.735489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.736110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.736393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.736666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.736854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.743452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 292/584] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/role_assignments?user.id=c3280a3468db42b29ce76accc1458f6e&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:50.743760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.748188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.750044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:50.767688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:50.769322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:50.770193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:50.770193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:50.770193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:50.771768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 293/585] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:50.772979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.779989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:50.874850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11837346-1b01-4a43-b6f6-af9ff6e72c92 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.892626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7b1f-6897-4dcc-85c5-cb9ca191fae3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:50.914492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.915107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.915391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.915664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.916354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:50.916664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.918061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.928827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:50.929463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:50.929745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:50.930019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:50.931776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 293/586] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:50.932592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:50.945945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:50.947425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:50.962240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:50.963207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:50.964155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:50.964155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:50.964155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:50.967932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 294/587] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:50.968801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.005681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.023857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.040313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926316-742f-48f4-9e50-2b3d63bb14e0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.073465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3334ae-bb1c-48a0-a06b-6ef4d53b6649 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.078817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.079479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.079762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.080061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/11ac5634282f478885ee36f51cf7ca55/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.095191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=11ac5634282f478885ee36f51cf7ca55, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.097194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.109169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.109834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.110124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.110395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.120185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 294/588] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:50 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/11ac5634282f478885ee36f51cf7ca55/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:51.120397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:51.120397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.120587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.120686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.134384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 295/589] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:51.135443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.253365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad258e88-55dc-433a-9ba5-c4d03792914d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.257846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.265280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e798-52ab-4f21-b9cd-8ab0b034ac2b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.298816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.299450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.299728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.300088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.303325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.308790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.311280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.311419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.312064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.312343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.312612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.313669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:51.313669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.315841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:51.327074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:51.328240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:07:51.329351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:51.331931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 295/590] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:51.334006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 296/591] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:51.334896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.336065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.460767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5a98-97f1-471a-afa5-bc34438665e3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.461598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5097b-b6e2-4243-b9bb-c684d15a4629 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.500002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.500841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.501188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.501548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.502377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:51.502688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.504213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.504346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.504968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.505344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.505724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.514035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.515663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.525522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 297/592] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:51.526422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:51.528193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:51.529293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:07:51.530455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:51.533005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 296/593] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:51.539206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.542737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.618929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.657518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd8e27-5119-4506-a02e-126c164664ca None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.684884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee4db-92bf-43e5-9b79-efa2d096ac53 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.697636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.698571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.699033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.699454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.707136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.708863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.722999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:51.723497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:51.724583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:51.725688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:51.726214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.726214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.726214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.732526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 298/594] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:51.733648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.746826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.748444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:51.763653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:51.764811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:51.765890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:51.765890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:51.765890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:51.767198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 297/595] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:51.768561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.828818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.859990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf019ea-5fdd-4102-abfe-ecbbce483e8c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.874240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b55d8-d17f-402c-9d87-1e7d4963a401 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:51.884205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:51.899425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.900385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.900820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.901280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.902308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:51.902839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.904582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.911353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:51.912082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:51.912453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:51.912802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:51.913623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:51.913993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:51.915481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:51.929983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 298/597] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:51.929983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:51.930640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 299/597] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:51.936970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.031022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad61fb-aa4a-4659-91c2-6682d4e305ce None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.046510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc5ac-6c3d-4dee-9f07-38487c163bf6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.066442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.067148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.067499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.067849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.068604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:52.068976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.070822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.080727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:52.083973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 299/598] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:52.084117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.093023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.094046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.094502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.094954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.108756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.110530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.120670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:52.130439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:52.131388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:52.132311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:52.132311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:52.132311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:52.138982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 300/599] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:52.140160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.203640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335762b-a2ca-4300-95a9-7387322bace8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.240910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733653c3-9529-4244-b599-50391a09f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.241564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733653c3-9529-4244-b599-50391a09f042 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.241851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733653c3-9529-4244-b599-50391a09f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.242128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733653c3-9529-4244-b599-50391a09f042 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/3fb472deed9140dcbb47301a3871a21c/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.249946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9142f-592e-448e-8060-0f191cf62c31 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.259233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733653c3-9529-4244-b599-50391a09f042 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=3fb472deed9140dcbb47301a3871a21c, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.260985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733653c3-9529-4244-b599-50391a09f042 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.282341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 300/600] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:52 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/3fb472deed9140dcbb47301a3871a21c/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:52.282341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733653c3-9529-4244-b599-50391a09f042 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.301714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.302728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.303269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.303725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.318481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.320758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:52.340187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:52.341133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:52.341989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:52.350026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 301/601] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:52.356069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.370496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:52.398257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733653c3-9529-4244-b599-50391a09f042 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.443980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.443980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.443980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.443980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.444717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:52.444717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.447028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.461627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 301/602] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:52.473622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.475998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:52.585718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709f866-034b-44bb-a700-f4adbf726524 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.605964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69651-ba03-4dc3-86cd-922393ac16ed None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.624212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.625340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.625774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.626451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.627688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:52.628700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.630304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.653660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.653660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.653660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.653660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.654137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 302/603] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:52.656938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.664373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.666022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.668062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:52.679746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:52.680880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:52.681976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:52.688061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 302/604] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:52.689950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.785685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6e0aa-4250-4505-bc97-b6f8a90ab7d3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.788718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:52.813589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda98b-3797-405b-81d1-413ad34f0c8a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:52.835013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3915e3-59e8-4f57-be9b-8f1abba06431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.835679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3915e3-59e8-4f57-be9b-8f1abba06431 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.836040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3915e3-59e8-4f57-be9b-8f1abba06431 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.836256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3915e3-59e8-4f57-be9b-8f1abba06431 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/0df436d79943414185c4a6c5c6f9c5ed/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.853881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:52.854762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.855253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.855662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3915e3-59e8-4f57-be9b-8f1abba06431 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=0df436d79943414185c4a6c5c6f9c5ed, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.855902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.856916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:52.857146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3915e3-59e8-4f57-be9b-8f1abba06431 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.857601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:52.859213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90195e-789d-4109-9947-43b878b9fd94 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:52.873996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 303/605] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:52 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/0df436d79943414185c4a6c5c6f9c5ed/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:07:52.875261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0fbb-f45a-4134-a4d4-91af881f8167 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.875547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0fbb-f45a-4134-a4d4-91af881f8167 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.876077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0fbb-f45a-4134-a4d4-91af881f8167 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.876519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 303/606] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:52.884014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 304/607] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:52.886361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0fbb-f45a-4134-a4d4-91af881f8167 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:52.887208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc646f-48ea-4f57-9f8d-2ff14c2941d2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:52.888631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc646f-48ea-4f57-9f8d-2ff14c2941d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:52.889781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc646f-48ea-4f57-9f8d-2ff14c2941d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:52.930178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d0dc646f-48ea-4f57-9f8d-2ff14c2941d2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:52.935138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d0dc646f-48ea-4f57-9f8d-2ff14c2941d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:53.052410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0fbb-f45a-4134-a4d4-91af881f8167 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:53.060373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:53.080507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 304/608] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:07:53.103355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a815-4ec9-4bf8-9873-bab63cd85a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:53.103975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a815-4ec9-4bf8-9873-bab63cd85a6c None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:53.104255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a815-4ec9-4bf8-9873-bab63cd85a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:53.104525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a815-4ec9-4bf8-9873-bab63cd85a6c None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/4bd62078f127457392fa0dd755ed1a86/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:53.120495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68a815-4ec9-4bf8-9873-bab63cd85a6c None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=4bd62078f127457392fa0dd755ed1a86, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:53.122108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68a815-4ec9-4bf8-9873-bab63cd85a6c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:53.135807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 305/609] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:52 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/4bd62078f127457392fa0dd755ed1a86/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:53.221715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14176c-2085-4d84-96df-58f00ad76f82 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:53.222064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14176c-2085-4d84-96df-58f00ad76f82 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:53.222275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14176c-2085-4d84-96df-58f00ad76f82 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:53.223667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 305/610] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:53.229017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:53.229304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:53.229579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:53.238809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:53.261228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:53.262487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:53.358153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 306/611] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:53.403478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14176c-2085-4d84-96df-58f00ad76f82 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:53.542670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14176c-2085-4d84-96df-58f00ad76f82 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:53.587537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:53.588213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:53.588495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:53.588766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:53.601869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:53.606618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:53.607572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:53.608495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 306/612] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:53.619162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:53.681394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:53.757999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07afc-19b4-426d-a290-e2d8c2a7eb3e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:53.780356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:53.798287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:53.799120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:53.800254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:53.800679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:53.801654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:53.803234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:53.805487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:53.806928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:53.826331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 307/613] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:53.827453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:53.853207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb0a02-4c3d-4e83-9fec-e59aaf869079 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:53.918134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:53.918683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:53.918964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:53.919236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:53.938962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:53.944848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:53.945949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:53.946979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 307/614] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:53.954214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.020913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8437f50-562d-46f5-b815-ac902e7d0a4a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.083346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.084026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.084275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.084544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.090490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f4af-726a-4e20-9c75-24b061c8e854 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.108719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.110179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.112391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:54.135476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:54.136666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:54.137773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:54.137773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:54.137773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:54.137773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 308/615] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:54.144548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.157556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.158172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.158450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.158722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.159425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:54.159728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.161150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.179651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 308/616] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:54.183097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.249380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:54.338480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec135-cf01-4c4f-8e95-fe4dd79290ad None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.374322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.374963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.375242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.375513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.376201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:54.376506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.377145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c034-b865-4c00-afd2-ebbf362ccbd6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.378454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.391888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 309/617] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:54.397240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.449095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.449752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.450036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.450309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.473121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.474614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:54.503979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:54.504954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:54.505911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:54.505911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:54.505911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:54.516280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 309/618] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:54.517412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.535979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f321-1f96-4055-864d-24d0b4b2fc45 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.540286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:54.567340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:54.568638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.569896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.570389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.570902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.579148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.581234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:54.593355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:54.594266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:07:54.595208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:54.598375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 310/619] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:07:54.604268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.715203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91499e8-b029-4007-b6da-baca3e372d93 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.745419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3ace1-d7e7-4dda-ae0b-8566dd43044e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.763707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.764701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.765207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.765688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.767092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:54.767879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.770922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1463d0-7a31-4512-a8cf-c8a8d15cb7d0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.781324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.781929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.782207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.782475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.783128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:54.783423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.784899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.797241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 311/620] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:07:54.798415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 310/621] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:54.799007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714753fc-c5f9-46f1-b862-3276f3283201 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.799611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714753fc-c5f9-46f1-b862-3276f3283201 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.800122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714753fc-c5f9-46f1-b862-3276f3283201 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.801784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 312/622] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:54.803669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714753fc-c5f9-46f1-b862-3276f3283201 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.803849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:54.843351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:54.890442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:54.909907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c38b1-f635-4105-8aa7-bd1554cb95e7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.946638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.947271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.947554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.947822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.950119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714753fc-c5f9-46f1-b862-3276f3283201 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:54.956702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:54.958135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-234d6bb6-eed8-4025-ad46-379b5b6a6c51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:54.972920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:54.974015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:07:54.975037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:54.979320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 311/623] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:54.980660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.980944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.981214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:54.996642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:54.998090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:54.998829 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:54.999304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.002849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:55.004237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:55.012256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.014540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:55.036471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:55.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:55.038327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:55.038327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:55.038327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:55.040689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 313/624] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:55.042135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.096287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 312/625] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:55.098060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.182437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.215763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.226367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2dd6-1910-4147-8240-a65311cbce5c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.250316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c707b3-c00d-4e23-93d8-b0b4242611cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.288483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.289458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.289970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.290458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.291293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:55.291790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.292760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.293407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.293692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.293971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.294579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb595-05ea-4a51-b417-5d91bc350e40 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.294750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:55.295022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.296523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66420693-c720-4d5e-8d58-28652ef9d4da None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.309010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 313/626] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:55.310603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1380e-cf06-4a48-ac19-d9a9f13f2951 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.311086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1380e-cf06-4a48-ac19-d9a9f13f2951 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.311556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1380e-cf06-4a48-ac19-d9a9f13f2951 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.313347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 314/627] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:55.314390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1380e-cf06-4a48-ac19-d9a9f13f2951 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.321793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 314/628] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:55.323044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.323337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.323613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.347461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:55.348696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:55.419269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 315/629] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:55.420340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.427464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1380e-cf06-4a48-ac19-d9a9f13f2951 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.463948 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.471000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.472304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.472586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.472886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.480223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.481718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.493459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-01c738ed-19b0-4b72-8e19-d4eac9e37653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:55.495630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:55.496597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:55.497494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 315/630] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:55.498621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdc81-1f0b-451e-8db7-b737eaa00703 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.498903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdc81-1f0b-451e-8db7-b737eaa00703 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.499171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdc81-1f0b-451e-8db7-b737eaa00703 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.500410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 316/631] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:55.501155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbdc81-1f0b-451e-8db7-b737eaa00703 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.537668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6e20-50f7-4b59-848a-80bfdd923711 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.576132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308adbdf-c657-4a63-8e36-7d0d82fde29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.576741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308adbdf-c657-4a63-8e36-7d0d82fde29c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.577019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308adbdf-c657-4a63-8e36-7d0d82fde29c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.577288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308adbdf-c657-4a63-8e36-7d0d82fde29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.607245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbdc81-1f0b-451e-8db7-b737eaa00703 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.644567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.645446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.645736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.646007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.648002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308adbdf-c657-4a63-8e36-7d0d82fde29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.649453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308adbdf-c657-4a63-8e36-7d0d82fde29c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.656148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:55.661394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:55.662297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:55.663137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 317/632] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:55.663853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.717209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.719733 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.758406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 316/633] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:55.759731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.760048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.760323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.772523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4dcca-b617-46b2-a37e-2984e4f743a8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.777464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:55.778658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:55.805943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.806562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.806821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.807090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.807773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:55.808106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.809567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.821753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 318/634] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:55.822698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.844705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 317/635] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:55.845786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.929311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda65c6-7b1f-45c7-badd-a2476b993fe3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.942242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.943035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:55.950762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9b93-a2c6-4b36-b7ba-38cc09d4ee89 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:55.966117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.966723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.967001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.967273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:55.967927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:55.968258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:55.969620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:55.977566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 319/636] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:55.978342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:55.993332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:55.993903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:55.994188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:55.994461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.005156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:56.009975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:56.010892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:56.011718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 318/637] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:56.013139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.089417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05042e2-6baf-47fa-8a87-d29bc19397eb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.120844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ef43c-5da4-403e-ba9b-558ba4b58ca1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.125741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.126376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.126656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.126930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.137357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.138829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:56.152714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:56.153847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:56.154739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:56.154739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:56.154739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:56.155000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.155000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.155000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.155194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 320/638] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:56.155282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/c3280a3468db42b29ce76accc1458f6e/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.155354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.170982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=c3280a3468db42b29ce76accc1458f6e, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.172484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.183132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.184903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 319/639] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:07:56 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/c3280a3468db42b29ce76accc1458f6e/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:07:56.185818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.204815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.268767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3035b-171b-49e5-983c-426728ba5407 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.305198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.305847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.306131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.306408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.318168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049306-6ecd-44ec-8af9-dcbe52a38769 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.319843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.321945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:56.338414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:56.339387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:56.340325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:56.340325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:56.340325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:56.340325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 321/640] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:56.340325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.360900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.361540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.361824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.362661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.363336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:56.363644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.365125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.373463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 320/641] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:56.375868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.435587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.441935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.459688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ceb33-d288-4c1c-8bb2-e5b8a274cb73 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.477995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a080-c0a6-4c09-9a42-50f546fb69ff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.495044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.495787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.496101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.496378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.507713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:56.511484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.512132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.512416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.512689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:56.513082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:56.514029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:56.514861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:56.515475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:56.515475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.515606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 322/642] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:56.516225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.520279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.537427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 321/643] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:56.537427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.625091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8e8d7-6525-40f8-b444-bf92166c92fe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.645915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc12c-85a0-4d91-866d-d5b30510352f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.662858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.663469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.663760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.664040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.664693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:56.664979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.666347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.674154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.675546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.688235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 323/644] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:56.688235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.690092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.690736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.691018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.691293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.703105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.706487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:56.724176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:56.725139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:56.726170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:56.726170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:56.726170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:56.726170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 322/645] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:56.726170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.805967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d828028-46ec-48b1-8520-0c785020002e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.840407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.841008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.841285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.841555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.842214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:56.842510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.843319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434fe76-957b-45e7-a7f4-5cfa18cb3e47 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:56.843871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.853013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 324/646] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:56.853792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.884685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:56.885626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:56.886127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:56.886547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:56.893313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:56.894764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:56.905585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:56.906644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:56.907548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 323/647] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:56.908073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:56.919288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.952940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:56.965919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47b7fa-d080-4bbe-9072-eea4007cbd55 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.003528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.004465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.004595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.004792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.014429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.016066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.020195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb292-cb0b-45c9-90a9-baa17a293061 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:57.027627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:57.028718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:57.029654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 325/648] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:57.030264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.057188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.058116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.058549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.058987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.059631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:57.060002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.061348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.078243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 324/649] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:57.078243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.138520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a72ce-26eb-40da-9a12-3fd56a2c1d65 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.159217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.175751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.176418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.176756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.177041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.184763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.188168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.188397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028150d6-36b5-4162-a837-cfa51c616b36 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.189866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:57.205008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:57.206531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:57.207395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:57.207395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:57.207395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:57.207395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 326/650] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:57.208288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.228916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.229528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.229811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.230090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.230782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:57.231092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.232569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.249467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 325/651] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:57.249467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.314167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e280a-d334-4672-a286-f6796d3988f6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.352214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.352705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf44ae-9c11-4448-b8d4-ed009ae4bcaf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.352817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.353098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.353377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.354370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:57.354681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.357102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.380002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 327/652] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:57.380002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.392618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.393778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.394061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.394335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.402601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.404084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.410295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:57.416875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:57.417814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:07:57.418729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:57.423038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 326/653] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:57.423326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.445350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.487164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0554-4f98-4023-8b39-77025ecf226b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.521885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.522555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.522845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.523126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.523768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:57.524117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.525482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.528943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e82a0-a48b-4001-8a95-f9c5e44d1207 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.541542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 328/654] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:57.542218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.563754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.564460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.564687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.565478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.566215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=11ac5634282f478885ee36f51cf7ca55) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:57.566528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.567988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.580154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 327/655] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/role_assignments?user.id=11ac5634282f478885ee36f51cf7ca55&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:57.580154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.659297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.674541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a1f68-1560-42cf-a732-6e16477478b0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.676728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.695780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d332b-89a0-4e48-a0dd-e1638479feb1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.717925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.718930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.719436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.719924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.735811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.736483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.736764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.737101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.737841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:57.738148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.739874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.759279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 328/656] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:57.760176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.798449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.800377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.877209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e616b-757f-40c8-9403-43bdf906990e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:57.913951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:57.914626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:57.914914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:57.915193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:57.919979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:57.922491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:57.924971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:57.929497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 329/657] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:57.930348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:07:57.937487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:57.938431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:57.939339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 329/658] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:57.939949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:57.947184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.051898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ff16-9378-40f8-8d2b-ff355dbfc1c7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.057857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a68fd5-a085-459b-a5a8-97522be10627 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.097683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1826c08-20d1-4834-852c-36d06d0f8bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.097894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.098303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826c08-20d1-4834-852c-36d06d0f8bbd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.098534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.098634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826c08-20d1-4834-852c-36d06d0f8bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.098816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.098913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826c08-20d1-4834-852c-36d06d0f8bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.099089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.110520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.112685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:58.130142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:58.131273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:58.132613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:58.132613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:58.132613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:58.132613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 330/659] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:58.132613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.168106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.179853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1826c08-20d1-4834-852c-36d06d0f8bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.181368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1826c08-20d1-4834-852c-36d06d0f8bbd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.193870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.243295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342c72d-ca01-41aa-8c70-4eb76fbe9521 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.279935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.280578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.280863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.281318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.281888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:58.282173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.283614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.290038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 330/660] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:58.290038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33da80-579f-445e-bbcd-5c4143798a72 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.290038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33da80-579f-445e-bbcd-5c4143798a72 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.290038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33da80-579f-445e-bbcd-5c4143798a72 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.290038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 331/661] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:58.290038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33da80-579f-445e-bbcd-5c4143798a72 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.313353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 331/662] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:58.313353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.393110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.405076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33da80-579f-445e-bbcd-5c4143798a72 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.419085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cfaf2-7318-410a-974b-9ad6d432744a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.432749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.441808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.442409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.442693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.442971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.443619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:58.443927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.445628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2dd1e-d042-4169-9c34-f2e15cd1ed8b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.462112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 332/663] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:58.462112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.462112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.462112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.462692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.463711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.464195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.464739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.475567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.477120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.477607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:58.478893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:58.492510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:58.493500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:58.494373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:58.494373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:58.494373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:58.494373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 332/664] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:58.495106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.556213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 333/665] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:07:58.557073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.600458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b79b69-d651-4360-8122-03e1f987743b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.636717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.637437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.637726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.637995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.671210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.671910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.701567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257375ae-ea0c-4f3e-a4f1-9e899c18e6cb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.716330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.717786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.757915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.758558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.758835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.759103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.768822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.771096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:58.787448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:58.788357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:58.789241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:58.796461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 334/666] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:58.796953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.849435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 333/667] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:07:58.849435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.909053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.922116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff5067-d904-49ea-a835-3848e85f13f6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.951368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7ade4-4b24-480f-8d21-34f74e3b4227 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:58.957814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.958418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.958696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.959079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.959721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:58.960050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.961534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:58.970588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:58.974934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 335/668] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:58.976681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:58.991332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:58.991976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:58.992279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:58.992537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:58.993222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:58.993522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:58.994944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.007272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 334/669] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:59.008069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.083414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a6b43-681c-4183-a496-53ae469fca56 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.113090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da26e-d3f8-4dbf-8e12-9af6dbd7f761 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.117514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.118154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.118435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.118709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.130173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.131626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.138133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:59.146697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:59.147635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:59.153470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:59.153470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:59.153470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:59.153470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 336/670] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:59.153470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.153768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.153768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.153768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.153768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.164366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:07:59.170340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:59.171232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 335/671] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:59.172506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.211557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.264079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd3765-ddca-4352-8b79-574942de29fb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.285924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7f46-0642-4473-b83b-623036ec9db8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.299282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.299871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.300193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.300471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.306993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.308563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:59.320258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:59.321134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:59.322009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 337/672] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:59.322516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.326689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.327311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.327591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.327863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.328843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=3fb472deed9140dcbb47301a3871a21c) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:59.330022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.331651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.341921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 336/673] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/role_assignments?user.id=3fb472deed9140dcbb47301a3871a21c&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:59.341921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.405615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.474346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888d80-3ff0-4c75-aee7-dad7cdb92005 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.481400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67c0c-40a8-4cf9-b33d-1391ab23ec68 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.489103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.512950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.513564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.514022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.514305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.514955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:59.515254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.516657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.523379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.524273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.524741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.525688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.526437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:59.526816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.528712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.531066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 338/674] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:59.532070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.541837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 337/675] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:59.542882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.654659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687d43-e1c1-4d7a-ae80-c9e24f0a1aac None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.662059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaeb7c-5fa4-4776-9175-76fce355e5ea None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.673834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.691769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.692448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.692686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.693052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.693660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:59.694215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.695653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.700482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.701117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.701399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.701673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.709176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.710633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.712112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 339/676] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:59.713080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5a7b09c4-ce34-4f7c-9fc6-5bc379a3b423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:07:59.724320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:59.725422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:07:59.726532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:07:59.728518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 338/677] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:59.729952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123e31-3735-42b6-8b72-26e80bedeeed None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.730377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123e31-3735-42b6-8b72-26e80bedeeed None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.730800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123e31-3735-42b6-8b72-26e80bedeeed None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.736339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 339/678] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:07:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:07:59.737882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48123e31-3735-42b6-8b72-26e80bedeeed None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.749076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.824030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719d13-916b-4767-8590-f46eb36d7b9b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.849743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48123e31-3735-42b6-8b72-26e80bedeeed None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:07:59.861324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.862157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.862448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.862721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.874222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.875844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.883628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:07:59.884682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.884976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.885257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.886140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=4bd62078f127457392fa0dd755ed1a86) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:07:59.886457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:07:59.887914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b407-a940-45e6-8b3e-31e56132e5b8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:07:59.890402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:07:59.891316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:07:59.892249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:07:59.892249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:07:59.892249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:07:59.892249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 340/679] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:07:59.892903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:07:59.908798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 340/680] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/role_assignments?user.id=4bd62078f127457392fa0dd755ed1a86&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:07:59.908798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:07:59.908798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:07:59.908798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:07:59.920716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:07:59.921959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:07:59.953766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:07:59.998704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.003489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 341/681] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:08:00.004566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.026445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be098fa-a6b2-4f96-837f-f331c2748595 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.099792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.100460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.100742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.101028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.101729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:00.102035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.104666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.117777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cda9a-2931-4882-9651-f7fabeef3849 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.120815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 341/682] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:00.126180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.170086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.170706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.170984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.171259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.173058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:00.173363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.175307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.190053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 342/683] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:00.195852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.227515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.270008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89f8b-a13d-466f-ad14-b0f0aeaf48b7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.328605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.329220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.329499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.329768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.331029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=0df436d79943414185c4a6c5c6f9c5ed) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:00.331340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.332808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.339274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 342/684] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/role_assignments?user.id=0df436d79943414185c4a6c5c6f9c5ed&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:00.340167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.341214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14175-cb75-4a19-88a1-cc10aae7d8f7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.354119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.393460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.394506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.394984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.395446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.417252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.419060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:00.441635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:00.442616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:00.443572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:00.446430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 343/685] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:00.452331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.479165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035b5b-e78f-4673-8e32-f19006943f2a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.545247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.545832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.546116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.546404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.556988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:00.562961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:00.563855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:00.564709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:00.569706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 343/686] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:00.570972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.588203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.613241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019aabd-fc94-42f9-af2d-2bef9109c64c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.665224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.666203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.667274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.668069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.668545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.669751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:00.670235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.673110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.697173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 344/687] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:00.703028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.709820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2f68-73f6-402a-b12c-e033e277b712 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.747426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.748174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.748527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.748878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.749625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:00.750000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.751559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.765665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 344/688] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:00.766874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:00.811501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cef90e-5a80-470a-81eb-84bf3fe53432 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.846958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.847855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.848364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.848810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.861005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.886806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9158ee4-5c0b-4115-932e-2800fc4ec013 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:00.919339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:00.921558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.923506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.926980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:00.927922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:00.928480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:00.928961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:00.941555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:00.943403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:00.959310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:00.960303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:00.961182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:00.961182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:00.961182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:00.967816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 345/689] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:00.969284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.028695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 345/690] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:08:01.034200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.078742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:01.098778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a80d8-e2a7-4d67-a995-b8d931c91767 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.137695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.138677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.139028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883a21-c1fc-4b1b-b4da-68142d9e0957 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.139377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.139843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.140840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:01.141465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.143021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.160736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 346/691] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:01.162286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.192591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.193260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.193539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.193803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.212723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.214203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.236410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:01.245655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:01.246658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:01.248211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:01.248211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:01.248211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:01.248211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 346/692] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:01.256959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.283104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495a586-14d5-4ef1-b46d-58a0ea1e6c35 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.321336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.322435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.323033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.323502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.332940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.334966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:01.349155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:01.350201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:01.351125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:01.363080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 347/693] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:01.370704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.433936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:01.447376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b1dc5-a1d8-46fa-876c-d03b1f70b0d0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.515030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.515650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.515932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.516234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.516884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:01.517191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.518629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.543286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 347/694] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:01.547466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.561832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec8c21-6335-4c05-a5ac-aa225b5b3678 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.592417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:01.629297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.630284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.630762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.631245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.632259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:01.632787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.634520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.669233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 348/695] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:01.676190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.680224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99025-365f-488e-b0f9-4a7ec7e0f96e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.718945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.719802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.720855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.721199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.731225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.732743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3090cdc4-9bf8-4ece-8de0-4e7614e0759e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:01.745541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:01.746375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:01.747237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 348/696] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:01.752398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9277-de76-4166-95f8-5d1e4cb83e3b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.752693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9277-de76-4166-95f8-5d1e4cb83e3b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.752973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9277-de76-4166-95f8-5d1e4cb83e3b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.754269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 349/697] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:01.758483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9277-de76-4166-95f8-5d1e4cb83e3b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:01.796446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:01.821395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d117d8-639a-4ce6-b66d-d4c0dd797fc8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.858881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.859569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.859972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.860355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.883299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9277-de76-4166-95f8-5d1e4cb83e3b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:01.891515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:01.933034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:01.933786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.934214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.934522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.935335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:01.935888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.937345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8625d-969c-4b71-80f8-7ec0ed9a55cc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.949256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:01.950973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:01.955819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 350/698] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:01.957291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:01.957680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:01.958061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:01.976675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:01.977722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:02.063456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 351/699] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:08:02.063456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.067586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:02.103781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 349/700] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 14:08:02.109088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.225264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:02.225808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d724-c52a-4c1e-9794-66bc505256b5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:02.274163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:02.274788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.275069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.275343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.276447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=c3280a3468db42b29ce76accc1458f6e) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:02.276650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:02.278089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954829a6-3ef7-45e0-a8e1-b7dba50731d4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:02.293493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 352/701] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/role_assignments?user.id=c3280a3468db42b29ce76accc1458f6e&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:02.310879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731909c-fff5-4871-a2d9-907654377007 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.311214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731909c-fff5-4871-a2d9-907654377007 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.311438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731909c-fff5-4871-a2d9-907654377007 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.316100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 353/702] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:02.318830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.319371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.319648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.320705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce308d0-e7fd-4496-bb03-0f9b5b35f747 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:02.368750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:02.370752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:02.375015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:02.376252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.376748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.377339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.397195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:02.399111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:02.434937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:02.435998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:02.436893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:02.436893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:02.436893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:02.436893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 350/703] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:02.437568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.482420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:02.491344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 354/704] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:08:02.492595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.598742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a258d8-701d-4570-ba5b-0c980202d9db None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:02.617058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:02.624448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe64df7-43a5-4c2f-b8fd-3f185ac53ded None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:02.645646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:02.646291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.646768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.647213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.662691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:02.664504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:02.671870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:02.673381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.673873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.674926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.675830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:02.676645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:02.678523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:02.683979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:02.684962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:02.686035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:02.686035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:02.686035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:02.687053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 351/705] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:02.693118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.696814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 355/706] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:02.706282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.778988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:02.832682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3bf0f-6e7b-4b94-abe8-ef66aa88d974 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:02.843330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9b18-ba5e-4a10-8013-6ac233ba87a3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:02.879914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:02.880635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.880924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.881024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e684b-84ab-4122-977d-5a87565685da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:02.881209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.881555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e684b-84ab-4122-977d-5a87565685da None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.881835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e684b-84ab-4122-977d-5a87565685da None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.881928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:02.882106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e684b-84ab-4122-977d-5a87565685da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.882210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:02.883756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:02.889105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e684b-84ab-4122-977d-5a87565685da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:02.890525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e684b-84ab-4122-977d-5a87565685da None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:02.902523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 352/707] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:02.902523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-062e684b-84ab-4122-977d-5a87565685da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:02.903902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:02.905043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:02.906097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 356/708] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:02.910887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709754ba-37bf-4315-8e3a-fd83a4ab20d4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:02.911175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709754ba-37bf-4315-8e3a-fd83a4ab20d4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:02.911447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709754ba-37bf-4315-8e3a-fd83a4ab20d4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:02.913294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 357/709] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:02.913466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709754ba-37bf-4315-8e3a-fd83a4ab20d4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:02.934694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:03.021062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3f5b-345b-4b62-8bb2-dd0afbdafbe6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.021395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709754ba-37bf-4315-8e3a-fd83a4ab20d4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.039225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:03.056708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7e40e-cc28-4e96-a0ec-2447f21e0df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.057316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e40e-cc28-4e96-a0ec-2447f21e0df2 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.057587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e40e-cc28-4e96-a0ec-2447f21e0df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.057860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e40e-cc28-4e96-a0ec-2447f21e0df2 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.058497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7e40e-cc28-4e96-a0ec-2447f21e0df2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.059467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.059932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7e40e-cc28-4e96-a0ec-2447f21e0df2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.060139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.060414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.060688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.061337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.062815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:03.076484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:03.077615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:03.078447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 353/710] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Aug 17 14:08:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:03.079238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:03.098639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 358/711] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:08:02 2022] POST /identity/v3/users => generated 254 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:03.098639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.098639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.098639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.112526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:03.113999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:03.187604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 359/712] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:08:03.188815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:03.204440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:03.238328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8aa83-c98c-4550-9014-37e6a8315a66 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.297569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.298313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.298876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.299573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.300437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:03.300825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.302399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.305952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6f73-dbd5-41db-8369-aa1ab075bf73 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.308580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:03.317018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 354/713] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:03.323758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:03.356791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.357221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.357505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.357772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.358468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:03.358698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.360259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.366154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 360/714] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:03.371813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:03.446698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267cc13-5048-4d6b-b740-3c35295dc57a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.494195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.494963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.495340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.495710 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.496721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=11ac5634282f478885ee36f51cf7ca55) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:03.497243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.499398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.505279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54db51-7d6e-4182-b1d8-17ec098a3401 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.512004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 355/715] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/role_assignments?user.id=11ac5634282f478885ee36f51cf7ca55&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:03.547529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.548218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.548501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.548776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.550048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:03.550356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.551737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.559090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 361/716] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:03.581562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:03.599539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:03.717234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867a72-7ada-4354-bed7-dc4e846a40ae None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.800559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44934a93-d690-4352-9488-45742572ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.802465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44934a93-d690-4352-9488-45742572ae4a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.802465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44934a93-d690-4352-9488-45742572ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.802465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44934a93-d690-4352-9488-45742572ae4a None admin] PATH_INFO: `/v3/services/network` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.802465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44934a93-d690-4352-9488-45742572ae4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.804463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44934a93-d690-4352-9488-45742572ae4a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-44934a93-d690-4352-9488-45742572ae4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:03.814023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:03.815570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:03.816466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:03.823832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 356/717] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:03.825383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:03.857109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:03.929790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b662bd-f344-4fe3-9ff8-819e44818af9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:03.970079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:03.970614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:03.970954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:03.971229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:03.971863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] RBAC: Adding query filter params (name=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:03.972189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:03.973565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4d0b3-47d5-44ae-b9bf-8f5b52753451 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:03.982857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 362/718] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:03.984284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44934a93-d690-4352-9488-45742572ae4a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:04.075991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:04.095979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44934a93-d690-4352-9488-45742572ae4a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:04.130840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:04.131464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:04.131743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:04.132119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:04.132760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] RBAC: Adding query filter params (type=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:04.133060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:04.134511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79145f8-fb9d-4421-9452-f81eed24ad1a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:04.148049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 357/719] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:04.854675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a66f-6949-4f71-b576-2e3ef8f0e4b8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:04.855179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a66f-6949-4f71-b576-2e3ef8f0e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:04.855285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a66f-6949-4f71-b576-2e3ef8f0e4b8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:04.856840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 363/720] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:04.862641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:04.862926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:04.863197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:04.891504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:04.893305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:04.981648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 358/721] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:08:05.312694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a66f-6949-4f71-b576-2e3ef8f0e4b8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:05.417311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:05.425467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a66f-6949-4f71-b576-2e3ef8f0e4b8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:05.464750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:05.465397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:05.465678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:05.465951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:05.477113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:05.481844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:05.482784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:05.483644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 364/722] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:05.489600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:05.579612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:05.621897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ae04e-6567-4b6d-a287-7993cfc8c043 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:05.672784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:05.673490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:05.674300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:05.674635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:05.675319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:05.675717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:05.677130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b51e1-ba66-4605-bc59-17a21368a2ee None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:05.694340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 359/723] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:05.697774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:05.811651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ae891-c5de-404e-91f0-89ae71310655 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:05.857377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:05.858106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:05.858283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:05.858521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:05.864282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43741a-8400-4937-9855-7f3b1c2aa2dd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:05.864818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43741a-8400-4937-9855-7f3b1c2aa2dd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:05.865298 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43741a-8400-4937-9855-7f3b1c2aa2dd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:05.867064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 360/724] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:05.869583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:05.871007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:05.872675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f3d30-ea72-4409-b43e-931f3bf59d8e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:05.873171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f3d30-ea72-4409-b43e-931f3bf59d8e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:05.873650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f3d30-ea72-4409-b43e-931f3bf59d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:05.891979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:05.893056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:05.893941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:05.893941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:05.893941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:05.893941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 365/725] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:05.895850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:05.919780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-597f3d30-ea72-4409-b43e-931f3bf59d8e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:05.921394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-597f3d30-ea72-4409-b43e-931f3bf59d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:05.932341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.002426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4a914-ec38-491e-bffc-e004b3e5e71a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:06.063510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:06.064168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.064983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.065260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.065926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:06.066231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:06.067655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b2d4-3d0e-4101-8ed2-f4ca90eb5b09 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:06.082184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 366/726] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:06.083657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbed14-ab63-4fa0-84db-783df1ac73a5 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.083946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbed14-ab63-4fa0-84db-783df1ac73a5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.084246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbed14-ab63-4fa0-84db-783df1ac73a5 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.089939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 367/727] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:06.091060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbed14-ab63-4fa0-84db-783df1ac73a5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:06.171651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.190468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 361/728] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:08:06.191867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41369755-61f3-4b5e-8851-12410c673944 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.192187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41369755-61f3-4b5e-8851-12410c673944 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.192461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41369755-61f3-4b5e-8851-12410c673944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.222416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-41369755-61f3-4b5e-8851-12410c673944 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:06.223606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41369755-61f3-4b5e-8851-12410c673944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:06.226775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbed14-ab63-4fa0-84db-783df1ac73a5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:06.294984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:06.295633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.295909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.296209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.312014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:06.313511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:06.334323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:06.335333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:06.336313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:06.344441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 368/729] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:06.345142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.346136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:06.352738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 362/730] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:08:06.454541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d762-de26-48e9-916b-116a1d7bf13f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.455770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d762-de26-48e9-916b-116a1d7bf13f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.456160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d762-de26-48e9-916b-116a1d7bf13f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.461707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 363/731] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:06.473686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88708-266b-439c-8c2a-53eaef644192 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.474088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88708-266b-439c-8c2a-53eaef644192 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.474469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88708-266b-439c-8c2a-53eaef644192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.480437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180e619-997a-4cfc-a182-3bdc528771e2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:06.504268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5ea88708-266b-439c-8c2a-53eaef644192 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:06.505576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5ea88708-266b-439c-8c2a-53eaef644192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:06.509310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.519804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:06.520745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.521176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.521600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.522644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:06.523226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:06.524910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:06.554733 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 369/732] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Aug 17 14:08:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:06.560171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:06.601234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 364/733] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 14:08:06.607331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a515852-cddd-4ab7-bb23-3cb1ba0a45cf None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.607331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a515852-cddd-4ab7-bb23-3cb1ba0a45cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.607331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a515852-cddd-4ab7-bb23-3cb1ba0a45cf None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.607331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 365/734] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:06.607331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a515852-cddd-4ab7-bb23-3cb1ba0a45cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:06.676448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2a67c-8d79-4b30-a2a7-d5b72ed2f4e6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:06.710323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffee4af-a580-40d1-9be4-704c88add4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:06.710880 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee4af-a580-40d1-9be4-704c88add4da None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.711155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee4af-a580-40d1-9be4-704c88add4da None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.711422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee4af-a580-40d1-9be4-704c88add4da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.716065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a515852-cddd-4ab7-bb23-3cb1ba0a45cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:06.722001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffee4af-a580-40d1-9be4-704c88add4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-bffee4af-a580-40d1-9be4-704c88add4da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:06.726721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:06.727819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:08:06.728930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:06.737525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 370/735] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:06.737525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.737525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.737525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.747318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.756438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:06.757892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:06.760031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:06.760642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.760921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.761194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:06.806801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.833705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 371/736] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 14:08:06.834632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:06.850669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:06.852165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:06.944740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10d938-cec8-44c1-8461-9af04834879d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:06.953540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 366/737] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 14:08:06.954383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:06.981426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:06.989961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:06.990603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:06.990889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:06.991166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.001499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:07.007280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:07.008231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 372/738] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:07.009620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.059378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.063128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c413212-e602-4665-86ee-8499ae457667 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.098692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.099784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.099784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.099784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.100494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:07.100792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.102263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.110033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 367/739] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:07.110809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.130478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f901a3-333c-4560-8882-d64889671473 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.164465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.165095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.165373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.165643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.166276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.167645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.182856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 373/740] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:07 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:07.183644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.202932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.221914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c852f-ccbe-45bc-8efe-75a4910d72dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.271108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.271762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.272072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.272342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.285314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.286803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.299502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:07.302261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:07.303317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:07.304305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:07.304305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:07.304305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:07.308377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 368/741] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:07.309275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.312325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd7ac-5abf-402a-bc23-b568949f07c9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.354749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.355359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.355636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.355904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.356625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:07.356932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.358316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.367998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 374/742] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:07.369167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.418266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f017ed-c5c0-48ee-883e-ef881fec909f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.450421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.457331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.458268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.458559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.458992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.459650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.461060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.483997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 369/743] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:07 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:07.483997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.484277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d367-8df9-412c-bd39-da3e7ec625ba None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.553147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.553984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.554268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.554537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.570754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.572974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:07.593789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:07.594804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:07.596875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:07.596875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:07.596875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:07.600614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 375/744] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:07.601633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.612577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.629726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70095fc-5749-4cec-a448-cbde9cbc1946 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.684832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.685469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.685748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.686025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.687100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:07.687405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.689407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.708045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 370/745] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:07.709250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.749025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cc41c-bbb6-415c-9a1c-b72f2bcad39c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.779180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.792217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.793103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.793400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.793672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.808862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.810703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:07.831458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:07.832714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:07.833632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:07.833632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:07.833632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:07.833632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 376/746] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:07.834199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.836953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02386d3-4e50-4f09-b9e3-a050c8190001 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:07.890049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:07.890660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:07.890941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:07.891210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:07.891850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:07.892175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:07.894458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:07.904891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:07.913945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 371/747] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:07.915239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:07.965822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d48f9a-eeff-4c29-8610-2e83e9ef88d4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.003487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.003688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.003896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.004174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.011088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.012672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:08.024416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:08.025321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:08.026185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:08.030264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 377/748] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:08.031105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.043423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0cf61-8c96-4c6e-a2e9-fb945b6d7142 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.061263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.091193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.092515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.093205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.093653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.094748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:08.096151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.098213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.114346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 372/749] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:08.116011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.144267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dfb10-ab7c-4bfe-b173-7b494954986b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.163303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.187541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.189061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.190031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.190765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.201493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.203693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:08.218892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:08.219830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:08.221328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:08.222548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 378/750] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:08.223710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.243297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610057d-6e18-4a51-9222-65ad46132a34 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.280629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.281143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.281488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.281768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.282540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:08.282907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.284921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.303495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 373/751] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:08.304440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.338428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.358132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a310-a30d-4cb8-b2ad-aa1ea7f4625b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.402879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.404041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.404863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.405285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.414496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3efd3-5845-4bc2-9cd2-083a95480d80 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.415186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.417906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:08.433058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:08.434153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:08.435278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:08.437394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 379/752] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:08.438875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.453996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.454519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.455452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.455874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.456742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:08.457185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.458836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.477471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 374/753] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:08.478254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.492544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.562153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f329b7-697d-40d0-aa0f-7860539b2188 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.587780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.600102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c122-e105-40b8-8f9c-a642632f025a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.608745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.609621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.610431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.610918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.612849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=c3280a3468db42b29ce76accc1458f6e) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:08.613445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.615220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.623123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 380/754] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/role_assignments?user.id=c3280a3468db42b29ce76accc1458f6e&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:08.624416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.638359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.639062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.639420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.639764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.640606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:08.641170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.643024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.663079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 375/755] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:08.669146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.746268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919d68b-7c09-4c37-b9d6-d00fd532c2b6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.748021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.784481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.785397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.785960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.786405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.870646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.872047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.874761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87995-6dc1-4b1c-b10b-eea259710e8e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:08.951785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:08.952729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:08.953184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:08.953629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:08.976069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:08.977833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:08.988936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 381/756] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:08.994887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:08.995760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:08.998513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:09.007334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:09.008555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:09.009434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:09.009434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:09.009434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:09.009434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 376/757] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:09.017337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.115434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489735c-b27c-40cb-9c72-dc757ae05981 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.155895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.157023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.157492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.157990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.169916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.171711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d5594c6c-c9a0-438b-b15d-4bf412eeb946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:09.189330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:09.190317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:09.191200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:09.191200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:09.191200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:09.193452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 382/758] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:09.199927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d084-a355-4e0e-a08c-4944f4c51c61 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.199927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d084-a355-4e0e-a08c-4944f4c51c61 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.199927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d084-a355-4e0e-a08c-4944f4c51c61 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.199927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 383/759] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:09.203271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d084-a355-4e0e-a08c-4944f4c51c61 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.232203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753a73-4e05-4fcf-ae09-e87ba0215320 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.270772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.271376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.271643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.271911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.272616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:09.272963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.274344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603892-71a4-4340-b7a2-1b6bfd649feb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.284366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:09.291335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 377/760] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:09.292904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.293190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.293464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.327359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:09.328634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:09.340724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d084-a355-4e0e-a08c-4944f4c51c61 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.386280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.387340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.387626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.387901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.388845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:09.389204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.391312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.402274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:09.409512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 384/761] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:09.410772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.422182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 378/762] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:09.424406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.551785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871479c-2679-400b-b08e-ef53a61e7a3c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.567724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:09.568130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371ad3f-a772-49f8-86a2-e15c9ace112e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.590699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.591523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.591872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.592261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.600024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.601811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.609598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.610229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.610512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.610789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9c45f6dd-e9eb-467a-9932-d5fb8d3970e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:09.614623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:09.616374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 385/763] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:09.618366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb2604-86c3-468a-bee9-d6df245bea78 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.619604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb2604-86c3-468a-bee9-d6df245bea78 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.619749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.619902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb2604-86c3-468a-bee9-d6df245bea78 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.624803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.625019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 386/764] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:09.625019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb2604-86c3-468a-bee9-d6df245bea78 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-906dd8bc-4756-4001-a6b1-52a8d1df6afb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:09.638775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:09.640441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:09.641330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 379/765] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:09.647506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.647506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.647506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.667809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:09.669370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:09.727739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:09.756358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 380/766] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:09.757237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.771743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb2604-86c3-468a-bee9-d6df245bea78 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.807222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.807842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.808151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.808422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.809115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:09.809417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.810862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.826184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 387/767] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:09.827011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.871459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:09.885135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b25c-9fa7-410c-8395-5daa0d4f5b28 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.933432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.934683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.935747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.936579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.937839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:09.938865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.941286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:09.945352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb851-3a20-4f42-837a-343069f77153 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:09.962023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 381/768] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:09.962023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:09.992252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:09.992942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:09.993280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:09.993795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:09.994127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:09.995495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:10.007025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:10.008064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:10.008928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 388/769] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Aug 17 14:08:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:10.009714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.018944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:10.088040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff3c9-4248-4493-8065-e9bbae3eecd7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.110420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:10.115280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8033b1-c599-472b-bab6-1d4da66cd495 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.125355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.126023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.126301 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.126935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/11ac5634282f478885ee36f51cf7ca55/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.129261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=11ac5634282f478885ee36f51cf7ca55, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.130701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.151989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 382/770] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:08:09 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/11ac5634282f478885ee36f51cf7ca55/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:08:10.151989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.164941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.165562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.165889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.166166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.166992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=7bbe8721fc10483f9502fc3011ab4e06) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:10.167380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.169010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.176052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 389/771] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/role_assignments?user.id=7bbe8721fc10483f9502fc3011ab4e06&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:10.183628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.342668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:10.346880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b769f9-3430-4be4-bc6e-4e15476fc234 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.372494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae62231-18ff-4209-ac90-b9ef4ef96d43 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.396832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.398128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.398865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.399301 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.400287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:10.401058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.403055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.410425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 383/772] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:10.412564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.413203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.413482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.413758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] PATH_INFO: `/v3/services/network` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.414511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.415883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.416164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:10.429090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:10.430109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:10.430942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 390/773] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:10.437032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.476356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:10.592685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2fcf-5c65-47ff-b503-988d73baac91 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.650458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ee98-c713-4795-9da8-e95c31ef4fce None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.672716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.674292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.674774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.675264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.676134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] RBAC: Adding query filter params (name=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:10.676647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.678256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.691239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 391/774] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:10.692412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.693536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.694164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.694341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.694958 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:10.695260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.696657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.697567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.711870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 384/775] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:10.718443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.800996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:10.812409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:10.816505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886f615-e56c-497b-9c7b-e183ab96079f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.854494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.855309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.855421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.855629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.856290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] RBAC: Adding query filter params (type=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:10.856607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.857980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09723a-d7b5-4436-875a-5645c137708b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.863253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 392/776] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:10.864582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d09c7-e2d8-418e-9ec7-2548f6297aad None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.864872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d09c7-e2d8-418e-9ec7-2548f6297aad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.865149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d09c7-e2d8-418e-9ec7-2548f6297aad None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.870175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 393/777] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:10.870175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d09c7-e2d8-418e-9ec7-2548f6297aad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:10.926893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b03f2-1859-4c28-8899-29315713ebdf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.971450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:10.972599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.973394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.974147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:10.975145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] RBAC: Adding query filter params (interface=public, service_id=68f295e4de9f475a83a136bf9961fc81, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:10.975651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:10.976773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d09c7-e2d8-418e-9ec7-2548f6297aad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:10.977492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12656-a69f-4752-96a5-87778c67e834 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:10.987809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 385/778] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/endpoints?service_id=68f295e4de9f475a83a136bf9961fc81&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:10.989842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:10.990329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:10.990974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.013868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:11.014534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:11.014869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:11.015145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.015691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:11.015887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] RBAC: Adding query filter params (interface=public, service_id=26450614d5c8469aa364b7f778f2e84c, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:11.016225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:11.017555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:11.017750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:11.025609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 394/779] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:10 2022] GET /identity/v3/endpoints?service_id=26450614d5c8469aa364b7f778f2e84c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:11.026711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:11.046314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:11.108054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 386/780] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:11.109055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:11.153233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d16d-227a-4b76-b85d-d33da182d44d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:11.155568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:11.215367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:11.216389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:11.216882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:11.217337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.218125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:11.219693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:11.233543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 395/781] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:11 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:11.290365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0acf7-b7b8-462c-bd13-5229464a4461 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:11.337587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:11.338585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:11.339072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:11.339545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.340468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:11.342136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:11.354339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 387/782] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:11 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:11.428973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:11.549962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:11.570504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d639da-b41f-4430-8896-eb2f13700895 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:11.604694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:11.605372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:11.605655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:11.605923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.617638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:11.622810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:11.623703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:11.624575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:11.628453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 396/783] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:11.630437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:11.728386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:11.745126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0baf-c25d-489e-bd48-fcb3fdeaf7e0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:11.780970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:11.781589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:11.781871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:11.782148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.782969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:11.783281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:11.785067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:11.794027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 388/784] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:11.799811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:11.926585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a286-873f-4e4b-8f02-267130797e33 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:11.970817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:11.971843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:11.972357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:11.972844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:11.984113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:11.985908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:11.988578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:12.008473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:12.009450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:12.010338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:12.010338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:12.010338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:12.013878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 397/785] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:12.015763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:12.153142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b6a9c-e738-4bc8-9cd5-e6adfe472bb5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:12.200170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:12.201244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.201734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.202207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.203059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:12.203577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:12.205716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ab31-148f-47cb-89b2-e01d46160c23 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:12.222008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 389/786] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:12.227637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:12.388359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a465a-1dc5-433d-ae83-3d8b29ee7b59 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:12.392338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60897-ebb9-4ef6-b22a-54f341758278 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.392910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60897-ebb9-4ef6-b22a-54f341758278 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.393392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60897-ebb9-4ef6-b22a-54f341758278 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.394988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 390/787] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:12.401046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3b102-64bf-4616-a7f0-80968e1e0910 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.401676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3b102-64bf-4616-a7f0-80968e1e0910 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.402180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3b102-64bf-4616-a7f0-80968e1e0910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.426361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:12.426994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.427277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.427553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.436291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:12.437299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-12c3b102-64bf-4616-a7f0-80968e1e0910 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:12.437748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:12.439039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-12c3b102-64bf-4616-a7f0-80968e1e0910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:12.449109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:12.464078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:12.465011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:12.465946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 398/788] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:12.473049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:12.557790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 391/789] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:12.568336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:12.607145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c73c-57d6-441e-82fd-ff51c8cbea91 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.607466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c73c-57d6-441e-82fd-ff51c8cbea91 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.607757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c73c-57d6-441e-82fd-ff51c8cbea91 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.609425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 392/790] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:12.619199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.619481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.619756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.644257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:12.645483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:12.648312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441c6e2-5f55-455c-99e6-3645daa1f2e8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:12.706937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:12.707600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.707933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.708282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.709010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:12.709316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:12.711191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:12.746130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 399/791] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Aug 17 14:08:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:12.754746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:12.793226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 393/792] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:12.861660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eed46-8709-4b0e-b438-11a6fddc8eee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:12.881390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:12.901127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:12.902204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:12.902707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:12.903238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:12.914440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:12.916632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:12.932121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:12.933082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:12.933963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:12.933963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:12.933963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:12.935993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 400/793] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:12.949057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:12.994412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.100311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.106651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8b5f1-db7e-4448-8025-9c2785db1ab2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.145768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.146553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.146993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.147273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.159550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:13.163788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d4d50-83fd-4de9-be83-c94aa5993952 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:13.165623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:13.166553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:13.167744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 401/794] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:08:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:13.174138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.203763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.226669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.227796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.228273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.228973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.230177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:13.230661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.232255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.253796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 394/795] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:13.253796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.288159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5103fc-e713-4de1-bfc4-a4bd435988a3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.325202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.325890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.326177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.326454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.327121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:13.327427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.328915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.337825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 402/796] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:13.338589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.391555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ccec-dfe7-46ab-9a55-8609744c44e0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.427467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.437347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.440007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.440578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.441070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.454029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:13.459909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:13.460935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:13.461744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:13.469328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 395/797] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:13.471304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.556071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.573430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a27b1-ed01-406f-a506-3a9d3be2e4b8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.583886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65a297-ba56-4683-a65a-437c1788999f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.608435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.609065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.609345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.609617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.616461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.618000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.618551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.619181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.619470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.619742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:13.629738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:13.630612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:13.631632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:13.632080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.632379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.633442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 403/798] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:13.634361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7f9335f3-a1b8-4aa5-8310-ef6ac774048c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:13.652647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:13.653627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:13.654486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:13.654486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:13.654486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:13.658557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 396/799] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:13.659636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f93cae-5b24-49e7-b10f-d0cab2dc24f5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.659932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f93cae-5b24-49e7-b10f-d0cab2dc24f5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.660234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f93cae-5b24-49e7-b10f-d0cab2dc24f5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.661473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 397/800] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:13.662166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f93cae-5b24-49e7-b10f-d0cab2dc24f5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.708651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.748765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c47a62-919e-452f-a4b8-e120a7cd16cb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.778256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f93cae-5b24-49e7-b10f-d0cab2dc24f5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.786959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.787557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.787835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.788147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.789094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:13.789094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.790461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.799724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 404/801] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:13.800582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.815472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.815997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.816088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.816313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.816586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.817276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:13.817601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.819274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d3b3-b958-473a-84d3-fe3af1dbb527 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.830554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 398/802] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:13.831781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a324507-b8df-44f6-ada8-1c9a5daaad41 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.832094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a324507-b8df-44f6-ada8-1c9a5daaad41 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.832368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a324507-b8df-44f6-ada8-1c9a5daaad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.849250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1a324507-b8df-44f6-ada8-1c9a5daaad41 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:13.850436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1a324507-b8df-44f6-ada8-1c9a5daaad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:13.903741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b0d34-85a6-47e9-87c2-d0ec2fcaaaed None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:13.916410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 399/803] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:13.917822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e74cc-8e0d-4049-9a08-454464fa7df0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.918103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e74cc-8e0d-4049-9a08-454464fa7df0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.918365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e74cc-8e0d-4049-9a08-454464fa7df0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.919590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 400/804] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:13.920312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e74cc-8e0d-4049-9a08-454464fa7df0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:13.949867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:13.950726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:13.951191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:13.951667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:13.952535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:13.952846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:13.954216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:13.961723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:13.972452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 405/805] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:13.972452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.042730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e74cc-8e0d-4049-9a08-454464fa7df0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.044296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.080148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d0ca-6dbd-4c28-84b7-a410eecb6736 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.085025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.085661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.085942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.086216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.096610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.098057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d610102c-d254-4137-8fca-9f010d88f367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:14.112748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:14.113660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:14.114510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:14.114510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:14.114510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:14.114510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 401/806] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:14.115180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.115343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.115615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.119334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.119985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.120274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.120550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/c3280a3468db42b29ce76accc1458f6e/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.122519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=c3280a3468db42b29ce76accc1458f6e, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.123944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.144278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 406/807] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:08:13 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/c3280a3468db42b29ce76accc1458f6e/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:08:14.144485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:14.144610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.144698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:14.226555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 402/808] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:14.227479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.246447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.286655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0d7c-23ab-4f97-b8b8-e92f17f1068e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.321690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.336466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.337044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.337328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.337598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.348531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.349458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f820b-2f45-4e4d-811c-9b93ac318dc2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.349983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:14.363878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:14.365048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:14.366017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 407/809] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:14.366624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.391845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.392765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.393197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.393625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.394332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:14.394636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.396032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.407782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 403/810] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:14.413157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.486553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.497092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948423-b8aa-4ff1-8a21-277ef56dcb19 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.519218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5261b14-6015-4bc1-952d-ce04baae91ed None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.533880 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.534519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.534793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.535067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.535653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.537055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:14.545693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:14.546674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:14.547524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 408/811] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:14.549236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.562405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.563015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.563299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.563571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.564392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:14.564695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.566192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.584635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 404/812] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:14.585443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.613902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.666520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee702-8a74-4a52-9ec4-29cb8d4116c3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.688740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6dae2-614f-4e9c-9d94-89af278eb705 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.702507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.703451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.703881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.704346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.713077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.714531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.718121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.724613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.725248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.725535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.725810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.726396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:14.726859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:14.727728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:14.728696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:14.729211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.733427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 409/813] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:14.733427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:14.743847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:14.744885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:14.745704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 405/814] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:14.746968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.844125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c9293-728b-4ec8-bad5-32e4accaa755 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.851514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217ef65-daf8-4796-a8da-a1311b74e6c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:14.858521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.882828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.883356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.883635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.883907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.884573 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:14.884877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.886266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.887987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:14.888801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:14.889238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:14.889669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:14.890808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 410/815] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:14.891569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.905784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:14.908076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:14.924045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:14.925080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:14.925931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:14.925931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:14.925931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:14.929886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 406/816] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:14.930533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:14.977284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:14.998998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6e68e-d1ec-4278-bae3-7a3228ef3bfb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.031445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202868-e240-4f1c-bb69-dbbc055af2cd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.034236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.034855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.035137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.035412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.036166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:15.036475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.037911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.055997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 411/817] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:15.060820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.071751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.072395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.072676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.072946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.073577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:15.073881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.075246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.083998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 407/818] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:15.083998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.097769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.173034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ed661-17fd-4e27-8219-5ff052263862 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.187254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323029f4-554c-4338-b4a7-2aaedd9774a7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.199348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.209816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.210426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.210704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.210983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.211609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:15.211912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.213304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.218053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 412/819] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:15.218841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.229921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.230826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.230826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.231078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.231727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:15.232060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.233434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.245904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 408/820] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:15.246718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.328707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.334062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315aefe-2ee9-4bc4-a0b7-2f574cb18213 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.348711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef9cfc-7f77-41f1-a427-4beb51d85b33 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.371450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.372143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.372427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.372698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.386491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.387349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.387846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.388357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.389093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] RBAC: Adding query filter params (type=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:15.389471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.390906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.396381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 409/821] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:15.397067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.431444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.448677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.450124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.514209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201357f-bbf1-4e3f-b503-cc31cd01546a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.550815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.554002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.554650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.554932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.555318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.555916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 413/822] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:15.556773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.560880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.561857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.595983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 410/823] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:15.595983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.684210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feb0ae-808b-4a0c-a133-39139dd8b211 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.726827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.729972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.730622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.730902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.731188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.740376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.741661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48fe9-86f2-4cd4-afb5-7ef95bca5030 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:15.741883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:15.757862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:15.758749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:15.759777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:15.761523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 414/824] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:15.762525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.798870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:15.799497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:15.799778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:15.800138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:15.800783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:15.802170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:15.836268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 411/825] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:15.836268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:15.864232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:15.969606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486adfc1-320f-4a61-a46b-7a4f57bccd09 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.034979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.035626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.035908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.036213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.039058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d48a-f1bc-473c-bc75-043dce731c8e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.049141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.050614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:16.066513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:16.067475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:16.068387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:16.068387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:16.068387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:16.073167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 415/826] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:16.074162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:16.082667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.083580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.084252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.084777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.085669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:16.086172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.087976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.101700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 412/827] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:16.108057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:16.111978 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:16.193821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bbd1a-c871-4408-8c5e-24104f07ba8c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.195714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:16.238708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.239653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.239939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea90a-1294-4369-95d7-207e277c02b6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.240382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.240849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.241841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:16.243100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.244717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c62f-41f4-4105-8a55-3fb87c2a5be4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.257996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 416/828] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:16.259148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1064-c82a-4b69-a950-466dd74b77f4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.259436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1064-c82a-4b69-a950-466dd74b77f4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.259706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1064-c82a-4b69-a950-466dd74b77f4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.261040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 417/829] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:16.265483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1064-c82a-4b69-a950-466dd74b77f4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:16.281104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b0d08-d16d-430e-8134-24606b74ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.281772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0d08-d16d-430e-8134-24606b74ad03 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.282051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0d08-d16d-430e-8134-24606b74ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.282322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0d08-d16d-430e-8134-24606b74ad03 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/7bbe8721fc10483f9502fc3011ab4e06/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.297854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b0d08-d16d-430e-8134-24606b74ad03 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=7bbe8721fc10483f9502fc3011ab4e06, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.299380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b0d08-d16d-430e-8134-24606b74ad03 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.323985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 413/830] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:08:16 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/7bbe8721fc10483f9502fc3011ab4e06/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:08:16.323985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.323985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.323985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.338437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:16.339874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:16.393867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1064-c82a-4b69-a950-466dd74b77f4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.406129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:16.436396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 414/831] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:16.439562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.440313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.440660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.441002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.452106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.452106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:16.464447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:16.465425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:16.466287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:16.468365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 418/832] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:16.476991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:16.582495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafa8a-7579-4076-9c9e-f743877bbc68 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.617176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.617790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.618064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.618331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.619026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:16.619326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.620788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.633835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 415/833] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:16.639716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:16.665048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:16.703530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:16.750105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7cfd-4fcd-4cae-b34b-252226e6394e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.771709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:16.791732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.793094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.794090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.794903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.796211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=11ac5634282f478885ee36f51cf7ca55) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:16.797243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:16.799834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:16.811203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 419/834] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:16 2022] GET /identity/v3/role_assignments?user.id=11ac5634282f478885ee36f51cf7ca55&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:16.852025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece4f-e346-4669-8a34-86afe778d14c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:16.890915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:16.891991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:16.892502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:16.893001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:16.904940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:16.910731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:16.911695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:16.912551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:16.919991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 416/835] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:16.921725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:17.014049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:17.030363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b045db-d279-418c-9ad0-3287a1cfd220 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:17.066207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:17.066808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.067086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.067359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.068056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:17.068362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:17.069985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:17.083814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 420/836] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:17.085182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:17.189582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f9d2f-da29-48e4-82c7-43c12232ec46 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:17.191068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:17.225762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:17.226455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.226759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.227030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.238311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:17.239781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:17.254779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:17.255732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:17.256680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:17.256680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:17.256680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:17.260372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 417/837] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:17.262144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:17.371332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab73356-bc13-4af4-85e6-e0b571d4c6fb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:17.410193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:17.410841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.411065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.411328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.411984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:17.412292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:17.413673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:17.426660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 421/838] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:17.432035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:17.537541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425510a-c3c8-4a73-99bc-1c78542ec2ff None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:17.572677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:17.573363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.573652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.573974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.582121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:17.583626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dcadc404-6eb9-458f-9f8b-a01a05de96dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:17.594719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:17.596253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 14:08:17.597197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:17.601124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 418/839] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:17.602619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:17.617467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:17.658608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13ff98-5f70-408c-9b0c-0282e4979818 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.658907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13ff98-5f70-408c-9b0c-0282e4979818 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.659213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13ff98-5f70-408c-9b0c-0282e4979818 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.661065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 419/840] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:17.665866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.666149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.666423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.685879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:17.687048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:17.708305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:17.718340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af33dd0-9718-4913-b709-0687d43fb0e2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:17.754109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:17.754904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.755438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.755854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.756850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:17.757594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:17.759155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:17.782679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 420/842] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:17.782912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 422/842] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Aug 17 14:08:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:17.783921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:17.885700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ce484-5d63-4303-a199-8f5a9a9e660c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:17.921387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:17.922003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:17.922276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:17.922541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:17.938342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:17.993095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:17.994632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.061084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.104010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 421/843] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:18.106001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.141715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.163256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.186042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c069-cf00-4d8d-ba7f-848e2eedbe47 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.225368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.226115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36068a2-84e4-4810-8ee6-74fb7e458fac None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.226269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.226612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.226972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.227667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.229877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:18.239058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:18.240277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:18.241266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:18.247796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 423/844] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:18.248853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.268238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.269141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.269638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.270050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.281447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.283828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c87e51cf-76dc-4a18-8c0f-3bfdaec7e89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:18.299822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:18.300815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:18.301678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:18.301678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:18.301678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:18.303433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 422/845] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:18.304998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdd03d-0368-45ac-afde-a920c06e4986 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.305426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdd03d-0368-45ac-afde-a920c06e4986 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.305862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdd03d-0368-45ac-afde-a920c06e4986 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.307535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 423/846] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:18.309364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdd03d-0368-45ac-afde-a920c06e4986 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.357879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4678-ce09-4b9b-8b08-237bf1b2dbe3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.388729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.396840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.397975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.398444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.398914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.399722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:18.400669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.402696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230758-2fb9-40fc-8687-a94c4cf66f1c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.406438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.414066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 424/847] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:18.414066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.414066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.414066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.416809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdd03d-0368-45ac-afde-a920c06e4986 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.434222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:18.435605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:18.454144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.454780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.455058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.455331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.455991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:18.456299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.457669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.474480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 424/848] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:18.475491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.507016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 425/849] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:18.507870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.605222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c9b0-0962-480e-8147-55e6efd3bf72 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.607975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36235a5b-4d16-4eb8-a107-587955d03253 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.640757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.645918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.647028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.647326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.647702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.651628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.652439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.652886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.653324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.654106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:18.654816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.655383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.656541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.657064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.663223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 425/850] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:18.675032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:18.676205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:18.677199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:18.679322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 426/851] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:18.685653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.716726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.799436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.811568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d871d-12c5-4f8e-92ea-3d4b8b53c1cf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.851777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.852438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.852760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.853042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.853746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:18.854051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:18.855502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39a8e0-84ba-4bd8-83c9-31716bd86fb5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:18.868462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 426/852] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:18.869829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0ce2-5f22-4160-92b5-99cacc8a209c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.870176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0ce2-5f22-4160-92b5-99cacc8a209c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.870459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0ce2-5f22-4160-92b5-99cacc8a209c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.871659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 427/853] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:18.876915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae0ce2-5f22-4160-92b5-99cacc8a209c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:18.921954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f77e-a26b-4083-8168-a6d4bbafb21f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.959030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a2a6-b956-4cbc-a0b0-b6dd3e431d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:18.959903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a2a6-b956-4cbc-a0b0-b6dd3e431d0a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.960379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a2a6-b956-4cbc-a0b0-b6dd3e431d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.960803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a2a6-b956-4cbc-a0b0-b6dd3e431d0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.965904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:18.972336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a2a6-b956-4cbc-a0b0-b6dd3e431d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e594a2a6-b956-4cbc-a0b0-b6dd3e431d0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:18.977042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:18.977981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:18.978822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 427/854] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:18.980207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:18.980207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:18.980351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:18.994867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae0ce2-5f22-4160-92b5-99cacc8a209c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:18.997133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:18.998320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:19.032515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.033130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.033408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.033679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.034417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=c3280a3468db42b29ce76accc1458f6e) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:19.034730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.036194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.040668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:19.045138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 428/855] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:18 2022] GET /identity/v3/role_assignments?user.id=c3280a3468db42b29ce76accc1458f6e&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:19.045753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.075881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 428/856] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:19.182377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6fbc9-e110-4ac0-b21a-a389c0eb0b02 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.219340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.220036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.220322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.220595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.221265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:19.221567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.222946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.231759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 429/857] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:19.238374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.346551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d5f6-ab3e-43bc-a4ea-10b1c2fa5272 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.350941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.360912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:19.387317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.388250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.388547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.388813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.399761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.401258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:19.417257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:19.418616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:19.419509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:19.419509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:19.419509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:19.423212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 429/858] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:19.424523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.453549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:19.478965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e9ada-5892-445a-8286-fbafae3e0367 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.530351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.531071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.531353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.531675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.531988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702d8a-18ba-4f44-9124-ea4fe3ee3ea9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.532814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.534244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:19.557859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:19.558866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:19.559781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:19.564061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 430/859] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:19.566759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.581669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.582288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.582571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.582844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.583491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:19.583795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.585203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.602566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 430/860] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:19.605219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.660909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:19.696108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55425d5-3118-467a-92fc-a915db8ba23b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.713177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:19.743738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76578bcb-f530-46d4-928e-2ac2247e7d59 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.751582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.752521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.753321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.753896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.755039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:19.755816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.757604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.769194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 431/861] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:19.770891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.784718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.785380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.785659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.785935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.797644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.800045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:19.816010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:19.816960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:19.817893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:19.825481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 431/862] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:19.827325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:19.889361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77745-0fe3-43ff-9c72-9f291747a9e5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.926652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.927286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.927568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.927840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.928514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:19.928795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.930333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:19.931692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:19.936568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:19.950596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef3682-c3da-46ea-a71d-5c4401aaeacb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:19.988967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:19.989548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:19.989833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:19.990155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:19.990911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:19.991217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:19.992728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:20.013088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 432/864] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Aug 17 14:08:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:20.021163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:20.133242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21a7dd-6eff-48b9-8222-edfdebf49c56 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:20.169132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:20.169748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:20.170031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:20.170307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:20.241623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:20.245671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:20.247144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:20.353059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 433/865] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:20.358915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:20.364135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:20.466608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12737c4b-dc59-4d12-9c71-2cae6e5057bc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:20.504154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:20.505220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:20.505722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:20.506216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:20.516965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:20.518653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b173e6f3-88a7-42ba-a20c-a1606caf7c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:20.533856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:20.534826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:20.535769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:20.535769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:20.535769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:20.542151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 433/866] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:20.545046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:20.617997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cf77c-b43d-4ea0-b4e7-c6474cda693a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:20.618326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cf77c-b43d-4ea0-b4e7-c6474cda693a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:20.618560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cf77c-b43d-4ea0-b4e7-c6474cda693a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:20.620047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 434/867] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:20.625051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:20.625563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:20.626104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:20.647450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:20.649545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:20.652374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:20.656298 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1413522-39eb-4223-9481-c0ba0b4b8522 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:20.705200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:20.705819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:20.706101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:20.706372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:20.707020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:20.707322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:20.709167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:20.718961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:20.723856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 434/868] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:20.732993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:20.746159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 435/869] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:20.840022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52abcc-519b-4b4d-818b-e6520f6fb57f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:20.874275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:20.874911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:20.875195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:20.875468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:20.882949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:20.884438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:20.895719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:20.896621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:20.897650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 435/870] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:20.904428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:21.007558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6939dd-18d5-40cb-b309-9b176feafd87 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:21.032743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:21.049368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:21.050051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.050331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.050603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.051355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:21.051670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:21.053139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cace82-20ec-469b-b510-8e25d91e8cb7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:21.053611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:21.065974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 436/871] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:21.067042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb0fe-b2f7-4af4-916c-a93409af7300 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.067333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb0fe-b2f7-4af4-916c-a93409af7300 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.067603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb0fe-b2f7-4af4-916c-a93409af7300 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.072002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 437/872] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:21.073039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb0fe-b2f7-4af4-916c-a93409af7300 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:21.125747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:21.144271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdcf09-aa44-4723-8e66-b42f9b5ab7ed None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:21.182618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524eb5-59e8-4cea-b619-62bf802097aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:21.183238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524eb5-59e8-4cea-b619-62bf802097aa None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.183523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524eb5-59e8-4cea-b619-62bf802097aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.183800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524eb5-59e8-4cea-b619-62bf802097aa None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.184485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524eb5-59e8-4cea-b619-62bf802097aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:21.185901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524eb5-59e8-4cea-b619-62bf802097aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:21.188376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb0fe-b2f7-4af4-916c-a93409af7300 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:21.204637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 436/873] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:21 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:08:21.205904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.206193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.206467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.237586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:21.238603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:21.238894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:21.239719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.240257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.240784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.241778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=7bbe8721fc10483f9502fc3011ab4e06) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:21.242379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:21.243938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:21.260504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 438/874] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:21 2022] GET /identity/v3/role_assignments?user.id=7bbe8721fc10483f9502fc3011ab4e06&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:21.330610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 437/875] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:21.600985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:21.709550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576b97-e9bb-4757-a704-a2bc04565740 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:21.717295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:21.749483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:21.750432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.750945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.751416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.752257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:21.753837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:21.763530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:21.764551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:21.765380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:21.772156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 439/876] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:21.774215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:21.785260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:21.879687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df52c4c-988f-4607-8515-fa54196f8923 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:21.916443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:21.917053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.917331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.917601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.918231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:21.918531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:21.919895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56ab3-4afa-45fb-adfe-5563a3f9f22f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:21.925385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 438/877] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:21.930907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:21.989899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa22a6-ab68-4c30-9f46-99f810c4b043 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.990210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa22a6-ab68-4c30-9f46-99f810c4b043 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.990456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa22a6-ab68-4c30-9f46-99f810c4b043 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:21.992103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 439/878] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:21.996676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662cbe-8f1b-4b4b-bd31-39ec626b7731 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:21.996973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662cbe-8f1b-4b4b-bd31-39ec626b7731 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:21.997260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662cbe-8f1b-4b4b-bd31-39ec626b7731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:22.019389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-41662cbe-8f1b-4b4b-bd31-39ec626b7731 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:22.020779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41662cbe-8f1b-4b4b-bd31-39ec626b7731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:22.043415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a06d0-f249-46d5-b836-035ca82ec4cf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:22.078183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:22.078782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:22.079627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:22.079900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:22.080567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:22.080867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:22.082233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:22.095991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 440/879] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:22.105876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 440/880] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:22.381869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:22.418123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:22.486577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee3f05-7967-4695-9f6b-6a7890abd2a7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:22.519692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9dbd8-3d51-464d-8d1c-21e29ba88024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:22.520325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9dbd8-3d51-464d-8d1c-21e29ba88024 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:22.520603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9dbd8-3d51-464d-8d1c-21e29ba88024 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:22.520870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9dbd8-3d51-464d-8d1c-21e29ba88024 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:22.521536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9dbd8-3d51-464d-8d1c-21e29ba88024 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:22.522885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9dbd8-3d51-464d-8d1c-21e29ba88024 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:22.539795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 441/881] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:22 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:23.178172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329690e9-04ea-4114-904d-b3c4ec125537 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.178682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329690e9-04ea-4114-904d-b3c4ec125537 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.178682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329690e9-04ea-4114-904d-b3c4ec125537 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.180217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 441/882] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:23.185498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf509-f39b-4a29-acaa-b2972e17ffdb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.185906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf509-f39b-4a29-acaa-b2972e17ffdb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.186072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf509-f39b-4a29-acaa-b2972e17ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.209910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4b4cf509-f39b-4a29-acaa-b2972e17ffdb None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:23.211153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b4cf509-f39b-4a29-acaa-b2972e17ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:23.288219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 442/883] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:23.317046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40b486-3ef0-4a30-9c86-f44c110d8f0f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.317337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40b486-3ef0-4a30-9c86-f44c110d8f0f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.317620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40b486-3ef0-4a30-9c86-f44c110d8f0f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.319476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 442/884] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:23.324544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.324834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.325113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.343377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:23.345130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:23.358966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:23.416078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 443/885] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:23.564766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40b486-3ef0-4a30-9c86-f44c110d8f0f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:23.567748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:23.678406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40b486-3ef0-4a30-9c86-f44c110d8f0f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:23.698332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:23.716933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:23.717933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.718442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.718920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.719793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:23.721388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:23.730399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:23.731474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:23.732409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:23.735796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 443/886] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:23.743099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:23.811252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:23.827043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b053b-d23f-4e15-b88d-4dcdfb451e6b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:23.850139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9fc4e-2bbd-434d-9a05-2be061ff58fd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:23.870388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:23.871655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.872322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.872884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.888370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:23.891077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:23.891937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:23.892421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:23.892835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:23.893618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:23.894037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:23.895137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:23.896189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:23.897098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:23.902844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 444/887] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Aug 17 14:08:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:23.903011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:23.904785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:23.907886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 444/888] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:23.913596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:23.920805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.026902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ea279-f5b8-493a-97cb-f877db963844 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.027892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c3c1-7cb2-4754-a330-372b75baa2e3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.062557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.064137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.064878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.065094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.065376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.066010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:24.066306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.067679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621d108-d3ec-444e-b5f1-2d74dc548c04 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.070252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.070857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.071137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.071403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.072052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:24.072354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.073705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6be7bb-ee46-4379-b689-54c2f5422c76 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.081431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 445/889] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:08:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:24.081431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc81a5-effc-41d2-8248-86a83475d577 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.081431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc81a5-effc-41d2-8248-86a83475d577 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.081431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc81a5-effc-41d2-8248-86a83475d577 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.081431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 446/890] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:24.084825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 445/891] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:24.085035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc81a5-effc-41d2-8248-86a83475d577 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.091038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.091331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.091608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.114235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:24.115636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:24.160459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.189522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 446/892] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:24.190517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.200769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc81a5-effc-41d2-8248-86a83475d577 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.237808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.238831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.239310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.239857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.251486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.253366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:24.272286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:24.273285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:24.274179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:24.274179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:24.274179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:24.276383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 447/893] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:24.288017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.322624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb6baa-4f92-4097-b410-81ca89f92944 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.356793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.371834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.372564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.372876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.373119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.373818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] RBAC: Adding query filter params (interface=public, service_id=ed3f58d526a04ad4bff5eb9f612335a8, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:24.374342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.375490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.385319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 447/894] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/endpoints?service_id=ed3f58d526a04ad4bff5eb9f612335a8&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:24.386647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.399218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1bb1a-b251-410a-a012-158fccb32f54 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.431746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.450403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.451592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.452512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.453274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.454704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:24.455231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.457108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.473809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 448/895] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:24.475024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.493625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07b786-2e43-431c-a90c-e200cc613f1f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.529629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.530509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.531105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.531381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.532082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.533955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.539564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 448/896] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:08:24.540372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.584036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06748dd-d725-4de8-a5aa-a77db409479f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.602461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.624343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4796-5ceb-4f43-b053-95b562aafdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.624875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4796-5ceb-4f43-b053-95b562aafdef None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.625152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4796-5ceb-4f43-b053-95b562aafdef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.625419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4796-5ceb-4f43-b053-95b562aafdef None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.626641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4796-5ceb-4f43-b053-95b562aafdef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.628127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4796-5ceb-4f43-b053-95b562aafdef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.653553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 449/897] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:24 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:24.653553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc48a34-af09-4402-a92e-309bbeae15c5 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.653553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc48a34-af09-4402-a92e-309bbeae15c5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.653553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc48a34-af09-4402-a92e-309bbeae15c5 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.653553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 450/898] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:24.656666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.657762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.658105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.659448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bf7e-c7f3-4b54-9374-717fe12a51b5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.687419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:24.689250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:24.715933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.716609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.716897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.717166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.727357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.731390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:24.743761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:24.744845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:24.745880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:24.746438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 449/899] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:24.756888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:24.762034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.793980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 451/900] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:24.885343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1657cc-c8ae-43a7-ae9c-2ec49f7d0dd9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:24.895859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:24.922885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:24.923497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:24.923780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:24.924079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:24.924923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:24.925232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:24.926666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:24.945066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 450/901] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:24.950766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.060904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3ee0e-bcf8-46b2-9926-4779a4db78c6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.097029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.097970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.098728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.099189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.099562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.154407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.196008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.196008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.223159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0467-1942-460a-9cfa-35d1cc4c203b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.260009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.260733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.261083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.261425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.262086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.263527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:25.277104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:25.278221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:25.279315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:25.284126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 451/902] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:25.285884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.318518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 452/903] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:24 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:25.323678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.329582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.406082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.429662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a5486-5dde-4884-be31-7c0bcf6fa311 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.433566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258b25-31ac-4c9b-89f4-0095da571294 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.473229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.473858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.474138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.474411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.482613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.483246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.483525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.483793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.484452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:25.484753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.486254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.488961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.490895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.495982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 452/904] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:25.496859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:25.510972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:25.511919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:25.512851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:25.512851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:25.512851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:25.520622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 453/905] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:25.522293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.606426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.614263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681020a6-eb18-4a13-918c-9648d0065d09 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.643783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23df0f-3ae5-4b2c-8865-f2b2d5936ea5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.649874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.650489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.650773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.651049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.651685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:25.652031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.653542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.664202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 453/906] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:25.665106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.676719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.686894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.687732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.688350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.688905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.689729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:25.690217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.691916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.706338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 454/907] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:25.717210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.780535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa91603-0f6a-4fdb-8422-1a442c8a4370 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.817362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.818000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.818552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.818829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.819540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] RBAC: Adding query filter params (interface=public, service_id=1d7bcc8bc8da465a8cf6e3e95488a9da, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:25.819844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.821277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.833187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 454/908] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/endpoints?service_id=1d7bcc8bc8da465a8cf6e3e95488a9da&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:25.834679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.856064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f9558-6d60-40e8-9ca4-6af0fc7f5244 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.862021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.902931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.904199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.905004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.905699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.914085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.915704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:25.927968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:25.928878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:25.930100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 455/909] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:25.934612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:25.955670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d810f1-d20c-42d5-bfa9-0c306e63544c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:25.991336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:25.992025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:25.992156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:25.992323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:25.992601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:25.993212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:25.994595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:26.001335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 455/910] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:08:26.052814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064019c-215f-4cb3-9f07-a34d56679c48 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:26.091013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:26.091909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:26.092357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:26.092792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:26.093627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:26.094083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:26.096264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8cc4-67d9-484f-895f-6ab709e4fae1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:26.110263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 456/911] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:26.116364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:26.210138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:26.226984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc1b5a-6e76-4c09-8e4c-24e7858ac210 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:26.261802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:26.262467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:26.262753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:26.263082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:26.263874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] RBAC: Adding query filter params (role.id=4292f8de58de4e82a3e69a9aedf3147c, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=7bbe8721fc10483f9502fc3011ab4e06) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:26.264206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:26.265648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03836b47-3d23-4a5f-9c6c-d9690e0040ed None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:26.271638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 456/912] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:26 2022] GET /identity/v3/role_assignments?user.id=7bbe8721fc10483f9502fc3011ab4e06&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4292f8de58de4e82a3e69a9aedf3147c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:26.534496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dedd6-31e3-4907-8745-8f86c222a973 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:26.534997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dedd6-31e3-4907-8745-8f86c222a973 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:26.534997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dedd6-31e3-4907-8745-8f86c222a973 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:26.536579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 457/913] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:26.541716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b654-f6be-40e6-ad79-30db85eeacf0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:26.542006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b654-f6be-40e6-ad79-30db85eeacf0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:26.542283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b654-f6be-40e6-ad79-30db85eeacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:26.561351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a993b654-f6be-40e6-ad79-30db85eeacf0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:26.562556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a993b654-f6be-40e6-ad79-30db85eeacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:26.633532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 457/914] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:26.697396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e871c-0e15-435d-abd0-154e3377aced None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:26.698039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e871c-0e15-435d-abd0-154e3377aced None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:26.698516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e871c-0e15-435d-abd0-154e3377aced None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:26.700322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 458/915] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:26.706272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:26.706566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:26.706848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:26.725186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:26.726374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:26.797212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 458/916] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:26.916907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e871c-0e15-435d-abd0-154e3377aced None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.020263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e871c-0e15-435d-abd0-154e3377aced None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.027648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:27.055822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.056403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.056681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.056949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.057527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.058892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:27.068543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:27.069511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:27.070359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 459/917] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:27.077762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.084906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.095678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:27.190396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021b60-a952-41f6-9281-b7c1ddb842e9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.200611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e5b1e-b5fa-4047-993e-2dc67debcc4f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.225311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.225941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.226215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.226482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.227061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.228475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:27.237776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:27.238782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:27.239623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:27.240411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.240411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.240411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.240411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.241011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:27.241663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.243141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.247997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 460/918] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:27.247997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.248390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 459/919] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:27.261342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.279678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:27.362917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:27.364380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b57a-bcd3-4c0a-b978-fc8fc33a28b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.393986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8654a-0afd-45d7-a0e3-eefda846a58b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.398797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.399399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.399680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.399946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.400595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:27.400894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.402258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.411909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 461/920] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:27.413119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.434676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.435708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.436243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.436725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.437635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:27.438339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.440172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.451071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 460/921] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:27.452173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.511328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:27.515209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e86fd-fbe1-4eb5-89b7-106d7d5ec8d1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.549768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.550397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.550560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.550997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.551689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:27.552296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.553526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.563988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 462/922] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:27.565234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.570203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78837c4e-ded6-484e-a85c-c3801febea4c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.608953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.610019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.610488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.610967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.611812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.613687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.623535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:27.643771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 461/923] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:27.672778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2db12-5afe-4865-89b6-59a561d34bfd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.717277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.717884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.718179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.718442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.719134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] RBAC: Adding query filter params (interface=public, service_id=21542ad55de84bd2b1b437c150a619d0, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:27.720032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.721418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3af40-c1a8-478f-9eb8-2f6323ebd586 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.732031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 463/924] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/endpoints?service_id=21542ad55de84bd2b1b437c150a619d0&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:27.733216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:27.857896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47761d1-863c-45ac-af86-390934a541eb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:27.895918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19873e17-7f91-4ad9-9307-1e12bb1ae95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:27.896950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873e17-7f91-4ad9-9307-1e12bb1ae95e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:27.897437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873e17-7f91-4ad9-9307-1e12bb1ae95e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:27.897936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873e17-7f91-4ad9-9307-1e12bb1ae95e None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:27.898816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19873e17-7f91-4ad9-9307-1e12bb1ae95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:27.900501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19873e17-7f91-4ad9-9307-1e12bb1ae95e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:27.907891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 462/925] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:27 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:08:28.002988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cf30-63e5-4593-8fad-6a65589ea49d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.003337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cf30-63e5-4593-8fad-6a65589ea49d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.003543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cf30-63e5-4593-8fad-6a65589ea49d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.005207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 464/926] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:28.010952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79193a80-e19c-457c-abeb-20b99be82d41 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.011259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79193a80-e19c-457c-abeb-20b99be82d41 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.011517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79193a80-e19c-457c-abeb-20b99be82d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.031887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-79193a80-e19c-457c-abeb-20b99be82d41 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:28.033176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-79193a80-e19c-457c-abeb-20b99be82d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:28.096674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:28.113343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 463/927] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:28.197043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7d25-5933-4391-a170-b8bcc538299f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.197286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7d25-5933-4391-a170-b8bcc538299f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.197565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7d25-5933-4391-a170-b8bcc538299f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.199145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 465/928] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:28.204796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.205189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.205565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.224582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:28.225783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:28.297944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 464/929] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:28.387642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7d25-5933-4391-a170-b8bcc538299f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.414369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:28.497925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7d25-5933-4391-a170-b8bcc538299f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:28.534011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:28.535014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.535519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.536034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.536840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:28.538419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:28.547809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:28.548936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 14:08:28.550472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:28.552924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 466/930] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Aug 17 14:08:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:28.558980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.560833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.646447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:28.661307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6949-dd7a-4449-a415-b88156a5e857 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:28.673871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a01b9-6df7-473a-af7b-0b821c6cffed None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:28.694650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:28.696890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:28.697596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.697870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.698218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.708964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:28.713747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:28.714689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:28.715540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:28.719788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 467/931] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Aug 17 14:08:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:28.720779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.721889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:28.722799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.723284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.723863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.724840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:28.725295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:28.726977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:28.749410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 465/932] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:28.750626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.823239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5626-9d81-4a0b-964f-d0b46d6f59a1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:28.857811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:28.858423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.858700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.858971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.859655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:28.860472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:28.861842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:28.870132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 468/933] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:08:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:28.871736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd262-ee43-4f50-9b96-de836dec3434 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:28.875518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.886356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:28.913206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:28.914060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:28.914491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:28.914930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:28.915860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:28.916380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:28.918066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:28.929193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 466/934] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:28.930165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:28.976276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a19c-80c3-4984-aebc-ce863ae9bf31 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:28.983023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:29.012098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.013277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.013277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.013277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.024458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.025937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:29.040105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:29.041359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:29.042448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:29.042448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:29.042448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:29.042448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 469/935] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:29.046892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:29.050907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bbc15-bc6e-4a07-a712-b2fc56cc117c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:29.090713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.091647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.092212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.092755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.093601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.095983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.111931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:29.126920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 467/936] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:29.163792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610893c-0b7b-4611-9b31-83cf2ac17132 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:29.213846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.214827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.215301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.215720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.216579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:29.217037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.218679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.233771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 470/937] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:29.240034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:29.354367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be4174-6376-4cab-b953-e951ab48a878 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:29.356093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:29.392891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.393673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.394074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.394446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.402216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.403786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:29.415629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:29.416820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:29.418031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:29.419730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 468/938] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:08:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:29.426285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:29.530794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1899a-195e-4c6c-9610-19315326b89f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:29.549338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:29.569248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.570577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.571014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.571438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.572357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:29.572816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.574399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97051a11-87c0-4848-a0ba-2f24097f1296 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.594843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 471/939] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Aug 17 14:08:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:29.600341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:29.645007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186e0cd-51b1-4252-9dce-abe4f027da25 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.645566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186e0cd-51b1-4252-9dce-abe4f027da25 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.646006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186e0cd-51b1-4252-9dce-abe4f027da25 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.648434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 472/940] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:29.653330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.653774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.654440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.680676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:29.682161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:29.713142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfb3d7-3120-48c7-9cb1-11f54a17e1f8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:29.764492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.765126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.765402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.765671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.777623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.778879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.784170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 473/941] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-81e7d87d-7fbc-4815-842c-f44360cc525c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:29.804562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:29.805530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:29.806452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:29.806452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:29.806452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:29.806452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 469/942] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:29.811445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:29.919001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6d88-fe8d-4df9-b1f5-6850e1dcd5bd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:29.921302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:29.932139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac9a2-43ea-40e9-9cc3-796623af8b50 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.932716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac9a2-43ea-40e9-9cc3-796623af8b50 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.933192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac9a2-43ea-40e9-9cc3-796623af8b50 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.934726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 470/943] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:29.940373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.940898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.941708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.961495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:29.962099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:29.962382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:29.962649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:29.963285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:29.963585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:29.964975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:29.965699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:29.967901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:29.978846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 474/944] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:29.984333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:29.986016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.060312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 471/945] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:30.075689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.115734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652063-29b1-4aa5-9f40-4b770683f090 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.157002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.158104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.158631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.159111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.166342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.168094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:30.180168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:30.181094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:30.181996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:30.188233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 475/946] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:30.190202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ab91-23a9-4bf5-a463-dbd06b864575 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.190664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.218404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:30.237511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.238542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.238821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.239094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.240176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.241909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.245804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING keystone.server.flask.common [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 14:08:30.265438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:30.271211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.sql.core [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 14:08:30.271211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 14:08:30.271211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [parameters: {'id': 'a598dd48381a48c98a327ac2ebd373db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 14:08:30.271211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a598dd48381a48c98a327ac2ebd373db.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a598dd48381a48c98a327ac2ebd373db. Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:08:30.281358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 14:08:30.283069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application yield resource Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise self.value Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application session.commit() Aug 17 14:08:30.284235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.flush() Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application compat.raise_( Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 14:08:30.285320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 14:08:30.286364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:08:30.287542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [parameters: {'id': 'a598dd48381a48c98a327ac2ebd373db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.288566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:30.289432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a598dd48381a48c98a327ac2ebd373db. Aug 17 14:08:30.290502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.293363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 472/947] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Aug 17 14:08:30 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:30.299823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.317882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790dec2-0964-4798-9cb6-3453215abc25 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.357858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.358464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.358742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.359012 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.359752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:30.360082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.361511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.378455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 476/948] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:30.378455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.420665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d501-1927-4a9e-9b4d-c1a68d83be8c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.460324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.460962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.461265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.461515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.464983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:30.469024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.470505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.481564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833df5-0fb9-45d1-b7a0-6b792da21cbb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:30.481907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:30.482764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:30.483654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 473/949] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:30.484168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.524342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.524962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.525238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.525507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.526089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.527447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:30.536201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:30.537262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:30.538114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 477/950] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:30.538905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.550609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:30.596515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2b417-357a-4a60-82dc-5fcab4179967 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.631573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.632266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.632543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.632811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/7bbe8721fc10483f9502fc3011ab4e06/roles/4292f8de58de4e82a3e69a9aedf3147c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.635034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=7bbe8721fc10483f9502fc3011ab4e06, role_id=4292f8de58de4e82a3e69a9aedf3147c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.636509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.644585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d7ff-b7bc-4afb-9b39-b285587f45ae None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.659999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 474/951] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:08:30 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/7bbe8721fc10483f9502fc3011ab4e06/roles/4292f8de58de4e82a3e69a9aedf3147c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:08:30.659999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.683071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.683873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.684188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.684465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.685484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:30.685787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.687261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.716259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 478/952] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:30.797960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe753-121d-4ce8-907d-cd79aeedace5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:30.822681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:30.841207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:30.841837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:30.842121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:30.842398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:30.843073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:30.843380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:30.845422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:30.854030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 475/953] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:30.860426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:30.873170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:30.971443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419070-9ea0-4117-a993-c94b9d240eeb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:31.007072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:31.007927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:31.008464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:31.008887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:31.009747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:31.010194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:31.011790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f93b-f33a-43f8-9bd3-72a340272dd1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:31.017949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 479/954] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:31.023810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:31.134451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac324b2e-23e9-421b-a7bb-617664d93dc1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:31.169385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:31.169995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:31.170273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:31.170542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:31.171211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:31.173206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:31.187252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc62f08-5086-453f-9e8c-8a30913ceb04 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:31.187566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc62f08-5086-453f-9e8c-8a30913ceb04 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:31.187889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc62f08-5086-453f-9e8c-8a30913ceb04 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:31.189527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 480/955] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:31.194625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:31.194913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:31.195193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:31.197230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 476/956] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:31.215173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:31.216446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:31.296769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:31.305301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 481/957] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:31.581144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:31.627217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:31.690070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9bf6b-ddfa-4beb-af05-ec6fdb15825d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:31.727487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:31.728163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:31.731307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:31.731307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:31.731307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:31.731307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:31.740295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:31.741294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:31.742114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 477/958] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:31.747448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:31.853979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffbc7-c492-49e2-8f64-2502fa6876ac None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:31.889258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:31.889928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:31.890206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:31.890476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:31.891651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:31.891974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:31.893414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b652f1-a7ea-4834-a57b-1695f07fe91f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:31.898716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 482/959] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:31.903946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:32.007537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8d81c-4d01-416b-99c1-3f9c7f4064a5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:32.010283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:32.048230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:32.048833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:32.049110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:32.049380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:32.050002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:32.050303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:32.051735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c68c-e60c-40c1-86ab-ede162a03c04 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:32.056567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 478/960] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:32.678072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa73a1-7235-4870-9ef8-2515b9c5d748 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:32.678072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa73a1-7235-4870-9ef8-2515b9c5d748 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:32.678072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa73a1-7235-4870-9ef8-2515b9c5d748 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:32.678691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 483/961] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:32.683981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78ff7-92a8-4b2b-a1c4-9081369b57b3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:32.684819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78ff7-92a8-4b2b-a1c4-9081369b57b3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:32.685303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78ff7-92a8-4b2b-a1c4-9081369b57b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:32.704735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7ff78ff7-92a8-4b2b-a1c4-9081369b57b3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:32.706576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ff78ff7-92a8-4b2b-a1c4-9081369b57b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:32.777557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 479/962] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:32.863365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b333d00-df31-4651-a667-96e8540daa28 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:32.863871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b333d00-df31-4651-a667-96e8540daa28 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:32.864007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b333d00-df31-4651-a667-96e8540daa28 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:32.865594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 484/963] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:32.870724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:32.871022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:32.871302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:32.893454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:32.894645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:32.965323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 480/964] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:33.053723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b333d00-df31-4651-a667-96e8540daa28 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.117469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:33.160014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b333d00-df31-4651-a667-96e8540daa28 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.194996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633f3f-ceb0-4fe5-84e2-d7c8d4ccc012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.195681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633f3f-ceb0-4fe5-84e2-d7c8d4ccc012 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.195983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633f3f-ceb0-4fe5-84e2-d7c8d4ccc012 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.196323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633f3f-ceb0-4fe5-84e2-d7c8d4ccc012 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.210819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50633f3f-ceb0-4fe5-84e2-d7c8d4ccc012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-50633f3f-ceb0-4fe5-84e2-d7c8d4ccc012 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:33.215627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:33.216569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.217977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 485/965] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:33.222658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.232761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a85f0a-0d0c-4d62-95ae-977a0830b57b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.233360 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a85f0a-0d0c-4d62-95ae-977a0830b57b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.233835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a85f0a-0d0c-4d62-95ae-977a0830b57b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.237055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 486/966] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:33.241026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.241464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.241902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.253569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:33.261877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:33.263231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:33.328482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b286-6203-4c6b-94e0-ad5ce2998993 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.336012 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 487/967] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:33.336707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.377442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.378665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.379054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.379423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.380500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:33.380873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.383205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.396122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 481/968] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:33.400963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.412399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:33.470732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf10ba4-d703-487e-8411-84b15be1729d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.508944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:33.519250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.519868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.520230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.520493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.521126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.522291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751385a9-ed2c-43cb-89c2-1739d47d930f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.522561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.526296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING keystone.server.flask.common [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 14:08:33.542044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.sql.core [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 14:08:33.542044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 14:08:33.542044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [parameters: {'user_id': 'a507b03590f747fa8a1eb502dc28fe97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 14:08:33.542044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81596) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Aug 17 14:08:33.562426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:08:33.563883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application yield resource Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise self.value Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application session.commit() Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 14:08:33.564982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.flush() Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application compat.raise_( Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 14:08:33.565863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 14:08:33.566754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 14:08:33.567622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a507b03590f747fa8a1eb502dc28fe97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:33.570464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 14:08:33.572374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 14:08:33.574859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 14:08:33.574859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 14:08:33.574859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 14:08:33.574859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 14:08:33.574859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 14:08:33.574859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.582297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.582297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.582297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.582297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.582921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 488/969] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Aug 17 14:08:33 2022] POST /identity/v3/users => generated 160 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:33.583066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.583066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.584559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:33.597453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:33.598423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:33.599328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:33.599328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:33.599328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:33.604065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 482/970] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:33.604975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.711361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b67c-f5ec-458c-901d-acece25f47e0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.714004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705316d-b08e-439b-89db-1dbfe52ea7f5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.726369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:33.756311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.757007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.757291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.757576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.761098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.761703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.761979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.762245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.762898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:33.763200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.764581 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.765179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.766838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.781107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 483/971] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:33.781107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:33.781867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:33.782740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:33.783700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 489/972] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:33.785470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.787615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:33.890678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0700a8-436b-4483-90fe-d15b42274bd4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.896729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95b5a9-d11e-47c6-8757-aa26da68b4ce None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:33.926501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.927426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.927715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.928271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.928969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:33.929431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.931461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.934814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:33.935442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:33.935717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:33.936016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:33.936596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:33.938501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:33.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:33.949031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:33.949954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 484/973] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:33.950730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:33.973605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 490/974] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:33.974324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.009837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.028640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.068533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d585b5-3310-4e6f-baee-067b9be181c9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.091530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458be04-bdfd-4707-947a-ec9a1700c5f2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.109138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.110334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.110881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.111156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.118760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.121152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.131232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.131849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.132198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.132468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.135082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:34.135082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-944a39a6-e604-4224-b1a5-f30b7cbcd321 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:34.135281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:34.136175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 14:08:34.137098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:34.137622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73b360-2b60-4075-b43f-1172f7909bc1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.137705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 485/975] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:34.137705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dbaa0-275c-4659-8167-3add6dab140d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.137705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dbaa0-275c-4659-8167-3add6dab140d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.137705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dbaa0-275c-4659-8167-3add6dab140d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.138584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 486/976] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:34.142158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dbaa0-275c-4659-8167-3add6dab140d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.146746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 491/977] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:34.148274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.148707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.152093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.173714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:34.175233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:34.251432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 492/978] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:34.252458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.264001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dbaa0-275c-4659-8167-3add6dab140d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.289939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.296160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.299915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.300719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.301014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.301300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.302022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:34.302329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.303765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.322198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 487/979] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:34.327562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.373801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7dcae-570c-4e83-9883-86ba063f37d8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.408829 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.409438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.409712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.409978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.410612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:34.410910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.412361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.417653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 493/980] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:34.423283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.434943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcddba-3412-4ff6-9fdb-3ec874f6358a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.471096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.471790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.472114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.472390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.516914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.526600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.527399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ea945-a994-452a-ad7e-b39c00a87b40 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.542744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.544227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.561870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.562497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.563273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.563548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.564295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] RBAC: Adding query filter params (interface=admin, service_id=21542ad55de84bd2b1b437c150a619d0, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:34.564609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.565975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.571285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 494/981] 10.222.0.23 () {56 vars in 1249 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/endpoints?service_id=21542ad55de84bd2b1b437c150a619d0&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:34.572073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.643786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 488/982] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 14:08:34.644660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.672486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9ca1d-9ce0-4f1a-b974-30b935166758 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.706123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.706727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.707009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.707280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.707913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.709305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.724322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 495/983] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:34 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:34.725113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:34.736189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.746867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:34.760185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754d51-1236-4341-8223-1a70d0e7bd05 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.804965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.805499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.805776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.806045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.806656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.808066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.823986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 489/984] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:08:34.855036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725ec68-3479-42cf-a791-fb36d8dc80f0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:34.897189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:34.897868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:34.898122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:34.898394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:34.912046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:34.913174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:34.929099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:34.930121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:34.931014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:34.931014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:34.931014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:34.931014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 496/985] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:34.936370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:35.043781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dc8a4-8c83-4ed4-8894-f2c4a37dd905 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:35.078240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:35.079130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:35.079591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:35.080175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:35.080997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:35.081485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:35.083032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:35.095930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 490/986] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:35.101598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:35.169690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:35.207891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a58c-5249-419e-8512-02372b871ba0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:35.241980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:35.242609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:35.242887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:35.243156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:35.249784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:35.251283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:35.262383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:35.263297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:35.264221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 497/987] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:35.272711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:35.277550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:35.376916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09446099-c0b9-4078-b3b3-13f03b646652 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:35.411358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:35.411978 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:35.412277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:35.412553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:35.413244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:35.413552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:35.414984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63ee0d-f904-4740-ae0f-ed9f00cc3c48 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:35.431368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 491/988] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:35.432618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:35.530995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a658a-fda9-410e-8bec-507f31347c96 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:35.556315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:35.566331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:35.566933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:35.567214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:35.567485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:35.568515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] RBAC: Adding query filter params (role.id=4292f8de58de4e82a3e69a9aedf3147c, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=7bbe8721fc10483f9502fc3011ab4e06) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:35.568828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:35.570257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c004f5-ce4d-4914-8803-a8398dcb14de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:35.583997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 498/989] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:35 2022] GET /identity/v3/role_assignments?user.id=7bbe8721fc10483f9502fc3011ab4e06&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4292f8de58de4e82a3e69a9aedf3147c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:36.669935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1146-65c0-4fc8-b4c6-05687d9ca254 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:36.670490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1146-65c0-4fc8-b4c6-05687d9ca254 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:36.670490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1146-65c0-4fc8-b4c6-05687d9ca254 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:36.671977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 492/990] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:36.677395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:36.677809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:36.677974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:36.696594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:36.697791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:36.712814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2174d8e-b798-4aa4-ab59-27e4f6105746 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:36.713101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2174d8e-b798-4aa4-ab59-27e4f6105746 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:36.713376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2174d8e-b798-4aa4-ab59-27e4f6105746 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:36.714833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 493/991] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:08:36.719589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:36.719872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:36.720176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:36.739869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:36.741048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:36.769643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 499/992] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:36.808515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:36.818638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 494/993] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:37.038091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.079801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.145789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a7e1-97d4-4ed4-95df-43cfd70ae49f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.166875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:37.183358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.184032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.184320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.184665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.185269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.186646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.188014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7561c-bebf-4fda-94cb-70dfedff5fa1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:37.196546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:37.197541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:37.198391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:37.202681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 500/994] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:37.203544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.227787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.228623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.228912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.229514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.230384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.232256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:37.243816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:37.244825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 14:08:37.245665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:37.247131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 495/995] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:37.250770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.311214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:37.315773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4db92-f726-4a8e-a27b-72504df51f0f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.352725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.353379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.353660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.353980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.354480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcbead-aecd-4c9b-89d8-1dd7622f7e2c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.354647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] RBAC: Adding query filter params (name=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:37.354905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.356424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.364402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 501/996] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:37.367347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.398239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.398847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.399127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.399397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.400052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:37.400396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.401707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.411673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 496/997] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:37.412743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.421845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:37.477335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38917764-99c7-475d-8cf1-95c49e9db0ff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.512326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.512931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.513207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.513477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.514139 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:37.514447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.515868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754de8-6ffc-43fd-9368-afabbce49fa7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.516523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e518fd-eb91-4b40-946d-3218c3f3644b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.520686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 502/998] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:37.521830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113294-40d4-402a-866c-193361eee952 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.522115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113294-40d4-402a-866c-193361eee952 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.522384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113294-40d4-402a-866c-193361eee952 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.523567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 503/999] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:37.528215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02113294-40d4-402a-866c-193361eee952 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.541214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:37.553591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.554505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.554786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.555053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.555674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:37.555997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.557364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eae2e-915d-4cea-bebd-25af8cccbe09 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.562092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 497/1000] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:37.563317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.563599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.563877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.581537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:37.582715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:37.628167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02113294-40d4-402a-866c-193361eee952 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.641014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:37.650577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 498/1001] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:37.651371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.663062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.663668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.663939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.664249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.664970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] RBAC: Adding query filter params (interface=public, service_id=e02ce9a162314dc682b0810a594eb4d3, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:37.665257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.666625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.671545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 504/1002] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/endpoints?service_id=e02ce9a162314dc682b0810a594eb4d3&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:37.677365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:37.766776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401519-39ee-4b15-9e0a-bb1c45ecff77 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.785573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:37.787128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbc18-42a6-4ec2-bd57-cdaaa70ab769 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:37.804438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.805046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.805319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.805587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.806231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.807596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.824076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:37.824879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:37.825351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 499/1003] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:37.825529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:37.825817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:37.826453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:37.827821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:37.835994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 505/1004] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:08:37.927989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:38.045492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef82c2-3c87-414c-8d23-a3f659b38a7b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:38.080827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:38.081386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:38.081663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:38.081931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] PATH_INFO: `/v3/services/image` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:38.082514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:38.083879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:38.092609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:38.094132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:38.094984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:38.096428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 500/1005] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Aug 17 14:08:37 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:38.100513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:38.145399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:38.205155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11432-5fff-49d3-8b37-e03d26c03d6f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:38.239226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:38.239842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:38.240155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:38.240432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:38.241064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] RBAC: Adding query filter params (name=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:38.241373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:38.242744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec71292-957d-43d3-9128-73125add3526 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:38.252020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 506/1006] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:38.253413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:38.289344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:38.358716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b028d-7b25-4f50-bfda-6a29edc9c320 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:38.394848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:38.395461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:38.395745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:38.396047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:38.396685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] RBAC: Adding query filter params (type=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:38.396989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:38.398360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f1023-a276-40c3-af8b-cb27c6775b61 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:38.408204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 501/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:39.748659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7499-72ac-4222-bd31-68a54191c41d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:39.749053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7499-72ac-4222-bd31-68a54191c41d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:39.749249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7499-72ac-4222-bd31-68a54191c41d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:39.751226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 507/1008] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:39.753182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dd771-901e-4bc4-b959-2e8d05c591b4 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:39.753579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dd771-901e-4bc4-b959-2e8d05c591b4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:39.753758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dd771-901e-4bc4-b959-2e8d05c591b4 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:39.755495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 502/1009] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:39.755851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:39.756166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:39.756506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:39.760313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:39.760603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:39.760878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:39.775216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:39.776549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:39.781439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:39.782635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:39.855300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 503/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:39.857432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 508/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:40.120903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.130940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.152819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:40.166745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:40.228834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252254b2-7d5d-4afd-893f-9e00f5a161d6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.235175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18a79d-79d5-4db3-a825-033e70f376b4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.262640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.263265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.263544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.263814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.264411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.266305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.269857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644428-39cb-448b-a747-d4600dcfc1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.270492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644428-39cb-448b-a747-d4600dcfc1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.270771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644428-39cb-448b-a747-d4600dcfc1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.271045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644428-39cb-448b-a747-d4600dcfc1b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.272172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644428-39cb-448b-a747-d4600dcfc1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.273596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644428-39cb-448b-a747-d4600dcfc1b7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.275167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 509/1012] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:40.275460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:40.276669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 14:08:40.277510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:40.278228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16a74-a945-4acb-89c9-a24c96f8bc04 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.278228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16a74-a945-4acb-89c9-a24c96f8bc04 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.278356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 504/1013] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:40.278423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16a74-a945-4acb-89c9-a24c96f8bc04 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.278423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 510/1014] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:40.282264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.283933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16a74-a945-4acb-89c9-a24c96f8bc04 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.375384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:40.382869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ab655-26ac-4ce4-814e-a5c6ae4909c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.383643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16a74-a945-4acb-89c9-a24c96f8bc04 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.385179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:40.426336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.426524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.426944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.427069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.427222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.427310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.427491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.427576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.428154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.428246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:40.428457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.429586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.429806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00091-9b5a-4e75-9be5-55195bc397ae None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.434584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 505/1015] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:40.435720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.436036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.436319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.455190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:40.456424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:40.458740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 511/1016] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:40 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:40.459657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.530027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 506/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:40.573378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bdaea-3a68-4206-8dde-d2749715c7c6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.611858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.612507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.612787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.613053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.613689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:40.613992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.615340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.620331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 512/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Aug 17 14:08:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:40.626821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.718938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:40.731675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07268b9-9c8f-4237-a536-717796d57d53 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.769732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43256ed5-7ab9-4b94-88df-632adecac712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.770395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43256ed5-7ab9-4b94-88df-632adecac712 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.770611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43256ed5-7ab9-4b94-88df-632adecac712 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.770880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43256ed5-7ab9-4b94-88df-632adecac712 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.771537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43256ed5-7ab9-4b94-88df-632adecac712 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.772944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43256ed5-7ab9-4b94-88df-632adecac712 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.793428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 507/1019] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:40.805675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:40.829318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:40.920778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ffead-d8d5-456e-bf92-0bb8fd6c51b0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:40.965160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609587a2-a71e-40b3-ad70-33a49c1ac9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:40.965774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609587a2-a71e-40b3-ad70-33a49c1ac9e5 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:40.966048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609587a2-a71e-40b3-ad70-33a49c1ac9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:40.966319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609587a2-a71e-40b3-ad70-33a49c1ac9e5 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:40.966951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609587a2-a71e-40b3-ad70-33a49c1ac9e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:40.968385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609587a2-a71e-40b3-ad70-33a49c1ac9e5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:40.984595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 513/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:08:40 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:42.415650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb3c37-0896-4beb-9b79-a8cf83ada04b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.416206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb3c37-0896-4beb-9b79-a8cf83ada04b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.416206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb3c37-0896-4beb-9b79-a8cf83ada04b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.417723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 508/1021] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:42.423179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f4e47-575a-4e8a-9c33-a32aab1359b9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.423570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f4e47-575a-4e8a-9c33-a32aab1359b9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.423734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f4e47-575a-4e8a-9c33-a32aab1359b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.441613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c09f4e47-575a-4e8a-9c33-a32aab1359b9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:42.443059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c09f4e47-575a-4e8a-9c33-a32aab1359b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:42.513047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:42.524087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 514/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:42.796114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb3c37-0896-4beb-9b79-a8cf83ada04b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:42.810923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4230f2-e14f-4142-9632-b911c1d665e0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.811191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4230f2-e14f-4142-9632-b911c1d665e0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.811471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4230f2-e14f-4142-9632-b911c1d665e0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.813047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 515/1023] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:42.818258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbfebd-090e-4c00-92d7-1a463e200083 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.818547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbfebd-090e-4c00-92d7-1a463e200083 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.818823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbfebd-090e-4c00-92d7-1a463e200083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.838771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6fbbfebd-090e-4c00-92d7-1a463e200083 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:42.840551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6fbbfebd-090e-4c00-92d7-1a463e200083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:42.903487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb3c37-0896-4beb-9b79-a8cf83ada04b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:42.911408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 516/1024] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:42.912817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4235-c7f1-4419-a464-79031cd9010b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.913110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4235-c7f1-4419-a464-79031cd9010b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.913386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4235-c7f1-4419-a464-79031cd9010b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.914753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 517/1025] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:42.919742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.920054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.920334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.939997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:42.940895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:42.941181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:42.941523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:42.941801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:42.942070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:42.943440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:42.944893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:42.946642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 509/1026] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:42.951945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:42.966561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.014917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 518/1027] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:43.059129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca43f0c-044c-4177-85d4-664cb7275364 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.093084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.094437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.094909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.095372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.096207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.097822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.121270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 510/1028] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:08:42 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:08:43.182502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.247209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.292704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fdbd-cdd2-4038-b506-59d3fdf06119 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.295821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.333115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.334071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.334579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.334889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.345868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:43.350640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:43.351578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:43.352591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 519/1029] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:43.357985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.381807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.422386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec8fcf-425d-4829-9e5d-319fc74b7c7d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.461897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.462767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.463189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.463626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] PATH_INFO: `/v3/services/image` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.464488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.466038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.471934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa014c-525e-4dfb-92f5-b9a62bb51655 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:43.477095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:43.478258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:43.479278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:43.481322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 511/1030] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:43.487430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.495270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.509689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.510334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.510632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.510944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.511663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:43.512004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.513427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.521872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 520/1031] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:43.527485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.602174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02b55-9aaa-4458-9752-b9757a863f4c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.632644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.635577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52fd48-bcf7-4f2b-862a-b8fbc7a0d171 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.639093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.639780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.640666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.641012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.641717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] RBAC: Adding query filter params (name=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:43.642103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.643658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.648794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 512/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:43.654201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.676555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.677514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.677825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.678129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.689502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.691037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:43.707443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:43.708682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:43.709617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:43.709617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:43.709617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:43.709617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 521/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:43.714289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.756566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.772712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3502ec-1f15-4abd-ab0d-7e7401f23922 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.808374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.808986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.809267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.809548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.810166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] RBAC: Adding query filter params (type=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:43.810496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.812025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.819652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 513/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:43.825408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.828624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e53d06-50a2-44d0-810c-78bed637b61f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.865303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.865845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.866164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.866474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.867145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:43.867485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.868917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.881835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 522/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:43.887234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:43.893389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.946223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790d80-b328-4b92-b13a-d2cab861cabc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.981989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:43.982598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:43.982880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:43.983153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:43.983377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:43.983876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] RBAC: Adding query filter params (interface=public, service_id=6e9ebc4babf64812a0384046b68dbb7e, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:43.984362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:43.985569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:43.990869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 514/1036] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/endpoints?service_id=6e9ebc4babf64812a0384046b68dbb7e&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:43.992900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d161ef-7e4e-4870-a5fa-13ea426d4257 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:43.996262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:44.033493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:44.034284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:44.034568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:44.034842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:44.041992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:44.043435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:44.054929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:44.056063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:44.057205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:44.060736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 523/1037] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:44.061509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:44.104565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b0ee-6338-4ad3-8ec0-a9194b628d90 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:44.130802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:44.143392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:44.144276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:44.144276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:44.144562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:44.145166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:44.146707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:44.155006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 515/1038] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:08:43 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:08:44.176133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7517-be16-4650-8779-c8b8fa06888e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:44.214653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:44.215279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:44.215558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:44.215828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:44.216623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:44.216931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:44.218534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:44.242459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 524/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:08:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:44.244400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:44.354922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca0c4-e684-490a-a372-faa7d63e642e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:44.389160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:44.389698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:44.390020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:44.390807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:44.447306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:44.461169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:44.462628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:44.565600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 516/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:44.567255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:44.582511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:44.670690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da59c17-ead8-4dd4-abb8-31c227b3f900 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:44.706453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:44.707444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:44.707930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:44.708425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:44.718850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:44.720574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:44.738408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:44.739379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:44.745035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:44.745035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:44.745035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:44.745035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 525/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:44.747151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:44.838048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:44.851419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091fec-8881-4a8a-afa1-43d3192e56c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:44.885977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:44.886830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:44.887277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:44.887700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:44.888520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:44.888972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:44.890524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:44.907210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 517/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:44.908749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:44.972170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:45.011337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14e59-0694-4102-b11b-e6e105ce2138 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:45.044945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:45.045568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.045845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.046149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.052746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:45.054181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b0edb5c7-c649-40a4-b209-ffc496bde7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:45.066030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:45.066934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:45.073059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 526/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:45.074995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:45.113661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03ed5e-10ce-4663-8f66-10f7f3c46e9f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.113992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03ed5e-10ce-4663-8f66-10f7f3c46e9f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.114207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03ed5e-10ce-4663-8f66-10f7f3c46e9f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.115683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 527/1044] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:45.121769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.122061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.122340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.141978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:45.143182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:45.183937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e83c8-ba11-4327-b0d3-b7e3ba09578e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:45.214343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 528/1045] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:45.218825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:45.219454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.219731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.220035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.220748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:45.221053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:45.222592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:45.241232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 518/1046] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:45.243082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:45.299189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:45.345310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab83bf-57e5-4d16-bea5-abb8da9d8f9d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:45.378652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:45.379235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.379511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.379847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.380596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] RBAC: Adding query filter params (role.id=4292f8de58de4e82a3e69a9aedf3147c, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=11ac5634282f478885ee36f51cf7ca55) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:45.380897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:45.382313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:45.396280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 529/1047] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:45 2022] GET /identity/v3/role_assignments?user.id=11ac5634282f478885ee36f51cf7ca55&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4292f8de58de4e82a3e69a9aedf3147c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:45.480496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:45.492953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:45.588688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191261-2ae2-4da3-b621-e4ef7edb905e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:45.622306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:45.622936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.623213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.623481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.633930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:45.638695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:45.639601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:45.644797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 519/1048] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:45.646956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:45.754061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a8f9-af10-4a02-96f2-02f5b7b6a4de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:45.772117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:45.789371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:45.789980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.790258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.790535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.791192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:45.791497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:45.792889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:45.801815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 530/1049] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:45.807359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:45.885243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:45.919555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e82f9-ba3e-49d2-90da-2ed91171adee None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:45.954226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394db40-2513-47e0-ab65-1002ef82f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:45.954856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394db40-2513-47e0-ab65-1002ef82f32a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:45.955137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394db40-2513-47e0-ab65-1002ef82f32a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:45.955410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394db40-2513-47e0-ab65-1002ef82f32a None admin] PATH_INFO: `/v3/users/c05874fb348545ff9b90036e5ed97917` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:45.968494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394db40-2513-47e0-ab65-1002ef82f32a None admin] RBAC: Authorizing `identity:get_user(user_id=c05874fb348545ff9b90036e5ed97917)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:45.969924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394db40-2513-47e0-ab65-1002ef82f32a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:45.976378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 520/1050] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:08:45 2022] GET /identity/v3/users/c05874fb348545ff9b90036e5ed97917 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:45.977549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.054574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4032ce-3f18-41ed-95b1-c97acd169fa3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.054856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4032ce-3f18-41ed-95b1-c97acd169fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.055043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4032ce-3f18-41ed-95b1-c97acd169fa3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.056671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 521/1051] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:46.061329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.061614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.061940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.078933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b829c8-18bf-4bfe-b359-7877ea200e8b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:46.080130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:46.081321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:46.114750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:46.115350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.115632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.115934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.149160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 522/1052] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:46.166534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:46.186922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:46.188539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:46.288922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 531/1053] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 14:08:46.290329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.350329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:46.394388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71007920-e8bf-41a5-acb7-fb85cd1c27cb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:46.414550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.430646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:46.431407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.431782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.432185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.433395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] RBAC: Authorizing `identity:get_project(project_id=233fb5b8302a4c6bb96b9315111c67d1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:46.434916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:46.436924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 523/1054] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:08:46 2022] GET /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:46.442949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.514862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:46.535463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ae32-f049-40fc-b030-57954a0b4d98 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:46.556172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb144ceb-f2d3-4179-805c-5fc5b3b3204b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:46.573304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:46.573934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.574214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.574488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] PATH_INFO: `/v3/services/image` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.575067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:46.576584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:46.579369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:46.586998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:46.588006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:46.588864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 532/1055] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Aug 17 14:08:46 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:46.594234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.596518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:46.597126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.597404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.597674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.598509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=233fb5b8302a4c6bb96b9315111c67d1, user.id=c05874fb348545ff9b90036e5ed97917) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:46.598829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:46.600283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:46.605777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 524/1056] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:46 2022] GET /identity/v3/role_assignments?user.id=c05874fb348545ff9b90036e5ed97917&scope.project.id=233fb5b8302a4c6bb96b9315111c67d1&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:46.712183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a49ef0-d578-4a25-91ab-1963bcf11fee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:46.758488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:46.759135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.759389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.759665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.760335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:46.760647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:46.762032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:46.767252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 533/1057] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:46.773061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.876150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db022ef9-344b-43bb-b8de-e9286bba7e65 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:46.909439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:46.910054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:46.910330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:46.910598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:46.911224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:46.911529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:46.912924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f49d2-bdca-42ec-9ce7-f6129892aaa1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:46.917946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 525/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:46.924073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:46.935563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:47.031740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c13d3c-0534-4bba-aecb-990b8e1931c0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:47.066265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01c6c-cc28-45a5-b11c-e4217413785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:47.066877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01c6c-cc28-45a5-b11c-e4217413785f None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:47.067153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01c6c-cc28-45a5-b11c-e4217413785f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:47.067418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01c6c-cc28-45a5-b11c-e4217413785f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:47.068359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01c6c-cc28-45a5-b11c-e4217413785f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:47.069710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01c6c-cc28-45a5-b11c-e4217413785f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:47.092505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 534/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:08:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:08:47.297824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775c85-94c3-41d9-89d1-ec676bd70dd7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:47.298155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775c85-94c3-41d9-89d1-ec676bd70dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:47.298389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775c85-94c3-41d9-89d1-ec676bd70dd7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:47.299891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 526/1060] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:47.304949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:47.305244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:47.305524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:47.324236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:47.325428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:47.386028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:47.404050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 535/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:47.668663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775c85-94c3-41d9-89d1-ec676bd70dd7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:47.724862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:47.781972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775c85-94c3-41d9-89d1-ec676bd70dd7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:47.815321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:47.815979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:47.816258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:47.816533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:47.829088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:47.833857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:47.834732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:47.835559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:47.839966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 527/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Aug 17 14:08:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:47.841371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:47.940168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dc923-5773-40db-83b7-f259132aeaf4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:47.973812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:47.974405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:47.974682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:47.974952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:47.975609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:47.975910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:47.977310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:47.989695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 536/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:08:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:47.991255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.097617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84628f-560e-495b-8d91-782621d6884f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.111734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:48.134874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:48.135759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.136217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.136636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.147817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:48.149488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:48.164163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:48.165269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:48.166358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:48.166358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:48.166358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:48.168032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 528/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:48.174423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.230187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:48.279790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd244-90db-48f4-8a8b-2d1477120e76 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.312845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:48.313452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.313733 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.314019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.314642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:48.314948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:48.316336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d741b5-db7a-4d58-8d39-ab27d6225394 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:48.329454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 537/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:48.334849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.434791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ce6ad-aaab-4bce-aea6-271873a78376 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.470247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:48.470880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.471163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.471435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.478957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:48.480481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:48.491925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:48.493218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:48.494436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:48.494987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d053b24-3137-42bd-9834-1b663b03e940 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.494987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d053b24-3137-42bd-9834-1b663b03e940 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.495333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d053b24-3137-42bd-9834-1b663b03e940 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.496296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 529/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:08:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:48.499987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 538/1067] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:48.500141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.502354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.502637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.502909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.520540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:48.521836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:48.529548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:48.596936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 539/1068] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:08:48.612293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06540202-9eda-4595-8cda-b88dde801652 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.647348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:48.647982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.648271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.648549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.649281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:48.649587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:48.651024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:48.673412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 530/1069] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:08:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:48.675211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.720188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:48.782483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2e679-7c1e-400a-b7c9-86a7de22cb7f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.816776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:48.817405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.817938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.818211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.828272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:48.829713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:48.844534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:48.845943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:48.846845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:48.846845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:48.846845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:48.848269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 540/1070] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:48.851341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.865151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:48.939847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:48.960444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fb864-5a63-4a45-bc20-1138505590fd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.967552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:48.976929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4466a-f6f0-4b0a-8103-bf93ffa0f977 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:48.997345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:48.997878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:48.998157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:48.998430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:48.999150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:48.999457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.000860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01b4c-eaa0-4cfa-8ae5-ad467817ad44 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.012360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 531/1071] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:49.013184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7203-121d-4839-9f1c-e843bc6dbe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.013612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f35e4-a587-418f-bfbe-b26630c76089 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.013966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7203-121d-4839-9f1c-e843bc6dbe58 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.014064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f35e4-a587-418f-bfbe-b26630c76089 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.014253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7203-121d-4839-9f1c-e843bc6dbe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.014345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f35e4-a587-418f-bfbe-b26630c76089 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.014529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7203-121d-4839-9f1c-e843bc6dbe58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.016176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 532/1072] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:49.018092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f35e4-a587-418f-bfbe-b26630c76089 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.026689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb7203-121d-4839-9f1c-e843bc6dbe58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-81fb7203-121d-4839-9f1c-e843bc6dbe58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:49.031399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:49.032582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 541/1073] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:49.033630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.034619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.034619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.051312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:49.052511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:49.118339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 542/1074] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:49.118978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.125350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f35e4-a587-418f-bfbe-b26630c76089 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.163182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.163996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.164123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.164407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.171590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.173164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:49.183981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:49.185040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:49.186234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 533/1075] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:49.191109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.193964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.216391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.235181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016e30a-0c41-4b5e-88fd-3c4564797dd8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.272197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.272839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.273181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.273482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.274141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:49.274443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.275795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.284513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 543/1076] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:49.290245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.294356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154de5c-3343-466e-bdcf-cc7b5ea4261c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.329902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.330832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.330832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.331105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.331727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:49.332060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.333497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.351179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 534/1077] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:49.352150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.399426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c6fb-ef63-4e14-8b86-b892e557fc70 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.414285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.432737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.433370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.433652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.433927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] PATH_INFO: `/v3/users/c05874fb348545ff9b90036e5ed97917` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.435048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] RBAC: Authorizing `identity:get_user(user_id=c05874fb348545ff9b90036e5ed97917)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.437059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.438653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 544/1078] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/users/c05874fb348545ff9b90036e5ed97917 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:49.439409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.453946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079d98-35a5-41ac-8f89-2da2211ac0cb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.458889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.486969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.487629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.487911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.488206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/11ac5634282f478885ee36f51cf7ca55/roles/4292f8de58de4e82a3e69a9aedf3147c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.490358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=11ac5634282f478885ee36f51cf7ca55, role_id=4292f8de58de4e82a3e69a9aedf3147c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.491794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.504826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 535/1079] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:08:49 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/11ac5634282f478885ee36f51cf7ca55/roles/4292f8de58de4e82a3e69a9aedf3147c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:08:49.514309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.558100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde41f9-0e04-4953-b05f-8a779e374369 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.596577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.597199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.597475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.597742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.622126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921038-32d0-4f6d-b0c0-e5688e454427 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.651389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.666331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.666976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.667252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.667523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.668696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] RBAC: Authorizing `identity:get_project(project_id=233fb5b8302a4c6bb96b9315111c67d1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.670128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.672506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 536/1080] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:49.677417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.678524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.678961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.694489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.787237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6292b5-6fd3-40ef-84fa-2d27fbdd4590 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.787719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 545/1081] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:49.793383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:49.829845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.830422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.830698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.830964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1/users/c05874fb348545ff9b90036e5ed97917/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.833018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] RBAC: Authorizing `identity:create_grant(project_id=233fb5b8302a4c6bb96b9315111c67d1, user_id=c05874fb348545ff9b90036e5ed97917, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.834465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.848476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 537/1082] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:08:49 2022] PUT /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1/users/c05874fb348545ff9b90036e5ed97917/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:08:49.910612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e505f-4643-4f83-a6cc-1a1dbfbc0935 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:49.926530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:49.949574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:49.950220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:49.950498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:49.950766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:49.964093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:49.965569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0caac0da-e0a7-4409-ad87-a63488365df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:49.981954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:49.982973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:49.984739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:49.984739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:49.984739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:49.984739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 546/1083] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:49.989806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:50.044791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:50.096720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6479-870a-4610-a3bf-2021f41878dc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:50.130950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:50.131562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:50.131843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:50.132152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:50.132800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:50.133103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:50.134478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae68e0-2f65-4f38-aabd-e79565a313c8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:50.146511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 538/1084] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:51.403345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f211-1f67-4eab-bcfd-aff32c1907c1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:51.403896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f211-1f67-4eab-bcfd-aff32c1907c1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:51.403896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f211-1f67-4eab-bcfd-aff32c1907c1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:51.405329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 547/1085] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:51.410509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412ab7-39bd-47ca-b170-193a55484068 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:51.410908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412ab7-39bd-47ca-b170-193a55484068 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:51.411062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412ab7-39bd-47ca-b170-193a55484068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:51.429084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-11412ab7-39bd-47ca-b170-193a55484068 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:51.430271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-11412ab7-39bd-47ca-b170-193a55484068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:51.495205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 539/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:51.745967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774d5b1-3482-4ced-a4c2-b8b5f3c0f66c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:51.746380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774d5b1-3482-4ced-a4c2-b8b5f3c0f66c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:51.746664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774d5b1-3482-4ced-a4c2-b8b5f3c0f66c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:51.748014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 548/1087] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:51.753802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:51.754085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:51.754381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:51.761319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774d5b1-3482-4ced-a4c2-b8b5f3c0f66c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:51.772621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:51.773800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:51.810962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:51.844127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 540/1088] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:51.864122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774d5b1-3482-4ced-a4c2-b8b5f3c0f66c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:51.896816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:51.897438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:51.897717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:51.897989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:51.908148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:51.912786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:51.913851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:51.915088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 549/1089] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Aug 17 14:08:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:51.919813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.017602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16a86-8a96-4f5f-a290-efac1c45f94a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.050941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.051544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.051822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.052122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.052790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:52.053092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.054457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.062276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 541/1090] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:08:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:52.068151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.095728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.108905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.141089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.167006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d784af-7fca-43b2-91e0-b9da71eb0ed7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.200097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.200724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.201043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.201315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.210106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f63056-fff2-4ac2-991d-42d71d061c44 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.211802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.213273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:52.226824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:52.227761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:52.229065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:52.229065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:52.229065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:52.229065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 550/1091] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:52.234347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.243623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.244279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.244562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.245095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.255160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:08:52.259825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:52.260981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:08:52.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 542/1092] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:52.267251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.314893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.337172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb059e92-83f8-4a30-955e-c620367d95c0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.357088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.366039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3163c7-1a77-4631-ba55-8f6d39b05125 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.369721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.370329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.370613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.370889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.371530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:52.371837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.373259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.385143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 551/1093] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:52.391287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.403667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.404313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.404683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.404866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.405558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:52.405864 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.407217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.415580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 543/1094] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:52.421226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.486467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aed10-d241-481d-a68b-b101bf3c4118 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.517420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd9c5-915d-479e-80ed-76573a860e57 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.521686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.522316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.522598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.522874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.529741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.531224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.532992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:08:52.544046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:52.545006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:52.545969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 552/1095] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:52.550850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.552765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.553400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.553682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.553953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] PATH_INFO: `/v3/users/c05874fb348545ff9b90036e5ed97917` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.555097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] RBAC: Authorizing `identity:get_user(user_id=c05874fb348545ff9b90036e5ed97917)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.556553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.558140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 544/1096] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/users/c05874fb348545ff9b90036e5ed97917 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:52.564545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.589185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.649917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2edcf-e5d7-4d57-a05b-43d2bef9e851 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.663000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5448fe-4c36-4707-808b-0b41c400e08c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.682851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.683449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.683726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.684026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.684743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:52.685046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.686987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.696829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.697426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.697706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.697979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.703776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 553/1097] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:52.709408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.764217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.765733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.766646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.789416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.810245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e06eb-0bf3-4fa8-9675-2639bd0cabac None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.845080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:52.845616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:52.845890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:52.846155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:52.865369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 545/1098] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 14:08:52.871357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:52.910876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:52.912358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:52.965220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:52.968421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef0c6-d091-47bd-b94d-f96d3e79a636 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:52.990705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:53.002960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.003588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.003870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.004181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.005303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] RBAC: Authorizing `identity:get_project(project_id=233fb5b8302a4c6bb96b9315111c67d1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.006729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.013215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 546/1099] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:53.013389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 554/1100] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 14:08:53.014890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:53.016294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:53.116701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c2fb8-33f5-4540-baf5-1a3a095ab80b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:53.117227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d260b-02a0-41b9-b52a-ff8dde0fa243 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:53.151170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.151437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.151796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.152067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.152201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.152349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.152457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.152618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.153384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=233fb5b8302a4c6bb96b9315111c67d1, user.id=c05874fb348545ff9b90036e5ed97917) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:53.153690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.155676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.161361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 547/1101] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:53 2022] GET /identity/v3/role_assignments?user.id=c05874fb348545ff9b90036e5ed97917&scope.project.id=233fb5b8302a4c6bb96b9315111c67d1&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:53.162734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.164196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:08:53.180187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:53.186942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:08:53.188149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:08:53.188149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:08:53.188149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:53.188149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 555/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:08:53.188415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:53.247290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:53.293137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe7cee-8b0f-44b8-909d-dc2c3fb01e79 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:53.327645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.328291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.328568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.328836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.330255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:53.330255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.331119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.343358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 548/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:53.349271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:53.361461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:53.448110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc855-9169-4ae6-8c2d-b7a2b6518b28 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:53.480349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.480971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.481248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.481517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.488480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.489912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:08:53.501977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:08:53.503019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:08:53.508953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 556/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:08:53.510905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:53.609786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00944-46e3-4eea-bb51-784173f20cee None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:53.623625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:53.645210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.645822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.646102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.646375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.647067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:53.647377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.648851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b70acd-637f-4556-b079-befd733a3ce8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.660284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 549/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:53.666257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:53.732795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:53.767588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e3869-6df7-4e2c-b16a-edd0d5c2c738 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:53.800535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:53.801130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:53.801407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:53.801675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:53.802384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] RBAC: Adding query filter params (role.id=4292f8de58de4e82a3e69a9aedf3147c, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=11ac5634282f478885ee36f51cf7ca55) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:53.802687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:53.804121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14833cc-a076-46a8-aa3a-1cf975012fef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:53.809662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 557/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:53 2022] GET /identity/v3/role_assignments?user.id=11ac5634282f478885ee36f51cf7ca55&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4292f8de58de4e82a3e69a9aedf3147c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:08:55.069101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7dc7c-d0bc-45dc-9d44-500e9bf5b875 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:55.069618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7dc7c-d0bc-45dc-9d44-500e9bf5b875 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:55.069618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7dc7c-d0bc-45dc-9d44-500e9bf5b875 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:55.070918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 550/1107] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:55.076153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:55.076572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:55.076736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:55.094190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:55.095356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:55.157953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 558/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:55.420284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7dc7c-d0bc-45dc-9d44-500e9bf5b875 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:55.519566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7dc7c-d0bc-45dc-9d44-500e9bf5b875 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:55.551195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37c871-f737-469e-b0f0-9c5de541057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:55.551807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c871-f737-469e-b0f0-9c5de541057b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:55.552110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c871-f737-469e-b0f0-9c5de541057b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:55.552380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c871-f737-469e-b0f0-9c5de541057b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:55.553472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37c871-f737-469e-b0f0-9c5de541057b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:55.554899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37c871-f737-469e-b0f0-9c5de541057b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:55.556449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 551/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:55.562567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:55.620421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:55.658718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4682d3e-4c1d-4d14-93db-7186f010e540 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:55.691806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c1fe5-e996-418e-a33b-66734c44f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:55.692711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c1fe5-e996-418e-a33b-66734c44f387 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:55.692998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c1fe5-e996-418e-a33b-66734c44f387 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:55.693267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c1fe5-e996-418e-a33b-66734c44f387 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:55.693908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c1fe5-e996-418e-a33b-66734c44f387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:55.695336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c1fe5-e996-418e-a33b-66734c44f387 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:55.715174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 559/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:08:55 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:08:57.644938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2264f-c09c-429d-8a0c-b665fb639753 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:57.645483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2264f-c09c-429d-8a0c-b665fb639753 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:57.645483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2264f-c09c-429d-8a0c-b665fb639753 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:57.646823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 552/1111] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:08:57.651982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:57.652407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:57.652554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:57.671162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:08:57.672374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:08:57.738873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 560/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:08:58.004327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2264f-c09c-429d-8a0c-b665fb639753 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:58.047335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:58.101663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2264f-c09c-429d-8a0c-b665fb639753 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:58.135968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:58.136852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:58.137165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:58.137520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] PATH_INFO: `/v3/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:58.139726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] RBAC: Authorizing `identity:get_role(role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:58.141136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:58.142438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 553/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:08:58 2022] GET /identity/v3/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:58.148347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:58.195649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:58.244784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7241-d536-489c-9aa6-abb896919ec7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:58.277890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:58.278461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:58.278740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:58.279016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] PATH_INFO: `/v3/users/b6ff004f168d4b13858ca0f2ae413a3f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:58.292015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff004f168d4b13858ca0f2ae413a3f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:58.293448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:58.295031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 561/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:08:58 2022] GET /identity/v3/users/b6ff004f168d4b13858ca0f2ae413a3f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:58.301234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:58.397632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b60a-87c6-4231-b41a-354294132039 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:58.407909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:58.431194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:58.431786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:58.432098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:58.432372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:58.496475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:58.497908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:58.592778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 554/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:08:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:08:58.598450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:58.694130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252b862-1b7f-4877-9754-8cf38555e057 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:58.701121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:58.727480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1548993-3a86-4f9e-beb8-26a7aef94fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:58.728128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548993-3a86-4f9e-beb8-26a7aef94fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:58.728416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548993-3a86-4f9e-beb8-26a7aef94fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:58.728687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548993-3a86-4f9e-beb8-26a7aef94fa0 None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:58.729794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1548993-3a86-4f9e-beb8-26a7aef94fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=233fb5b8302a4c6bb96b9315111c67d1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:58.731228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1548993-3a86-4f9e-beb8-26a7aef94fa0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:58.732996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 562/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:08:58 2022] GET /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:08:58.739017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:08:58.750517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:08:58.835854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8abc60-baa4-4cea-832a-af15ebb09fd3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:08:58.868623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:08:58.869161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:08:58.869447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:08:58.869722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:08:58.870442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] RBAC: Adding query filter params (role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=233fb5b8302a4c6bb96b9315111c67d1, user.id=b6ff004f168d4b13858ca0f2ae413a3f) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:08:58.870751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:08:58.872201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae98e0-006a-48e3-a181-58964471956d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:08:58.877416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 555/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:08:58 2022] GET /identity/v3/role_assignments?user.id=b6ff004f168d4b13858ca0f2ae413a3f&scope.project.id=233fb5b8302a4c6bb96b9315111c67d1&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:00.727906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d208f1-a170-42ec-a2bb-8bc7c3f96902 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:00.728486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d208f1-a170-42ec-a2bb-8bc7c3f96902 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:00.728486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d208f1-a170-42ec-a2bb-8bc7c3f96902 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:00.729812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 563/1118] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:00.735817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:00.736271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:00.736396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:00.753986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:00.755174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:00.820810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 556/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:01.091098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d208f1-a170-42ec-a2bb-8bc7c3f96902 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:01.205289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d208f1-a170-42ec-a2bb-8bc7c3f96902 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:01.237304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:01.237918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:01.238196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:01.238468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] PATH_INFO: `/v3/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:01.239838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] RBAC: Authorizing `identity:get_role(role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:01.241231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:01.242525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 564/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:01 2022] GET /identity/v3/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:01.248270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:01.251789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:01.344378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab302-6755-45bd-87c1-2e41e51706fd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:01.376949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:01.377569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:01.377849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:01.378123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] PATH_INFO: `/v3/users/b6ff004f168d4b13858ca0f2ae413a3f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:01.379240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff004f168d4b13858ca0f2ae413a3f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:01.380696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:01.382264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 557/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:01 2022] GET /identity/v3/users/b6ff004f168d4b13858ca0f2ae413a3f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:01.387848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:01.430115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:01.485585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520a8e-8d84-4339-94ca-b40896f230d7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:01.517352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542963c-ad5b-4f74-9f79-25e8f169e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:01.517984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542963c-ad5b-4f74-9f79-25e8f169e053 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:01.518261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542963c-ad5b-4f74-9f79-25e8f169e053 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:01.518531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542963c-ad5b-4f74-9f79-25e8f169e053 None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:01.519639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542963c-ad5b-4f74-9f79-25e8f169e053 None admin] RBAC: Authorizing `identity:get_project(project_id=233fb5b8302a4c6bb96b9315111c67d1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:01.521089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542963c-ad5b-4f74-9f79-25e8f169e053 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:01.522688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 565/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:01 2022] GET /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:01.528727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:01.597645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:01.627250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2628c-ef3d-482b-89d3-71454790a6d3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:01.660568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5c456-1eb0-458e-9720-a9ca73b30f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:01.661213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5c456-1eb0-458e-9720-a9ca73b30f7a None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:01.661496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5c456-1eb0-458e-9720-a9ca73b30f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:01.661769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5c456-1eb0-458e-9720-a9ca73b30f7a None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1/users/b6ff004f168d4b13858ca0f2ae413a3f/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:01.663886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5c456-1eb0-458e-9720-a9ca73b30f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=233fb5b8302a4c6bb96b9315111c67d1, user_id=b6ff004f168d4b13858ca0f2ae413a3f, role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:01.665346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5c456-1eb0-458e-9720-a9ca73b30f7a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:01.677365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 558/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:09:01 2022] PUT /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1/users/b6ff004f168d4b13858ca0f2ae413a3f/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:09:03.513788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79a37-9487-420c-b43d-f21c28e5cdad None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:03.514343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79a37-9487-420c-b43d-f21c28e5cdad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:03.514343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79a37-9487-420c-b43d-f21c28e5cdad None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:03.515639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 566/1124] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:03.520934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:03.521320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:03.521489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:03.539502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:03.540718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:03.604969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 559/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:03.868716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d79a37-9487-420c-b43d-f21c28e5cdad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:03.967044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d79a37-9487-420c-b43d-f21c28e5cdad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:03.977498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:04.001050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:04.001668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:04.001950 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:04.002224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] PATH_INFO: `/v3/roles/c2a695d1f64b4e0ea309282cdd638470` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:04.003605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] RBAC: Authorizing `identity:get_role(role_id=c2a695d1f64b4e0ea309282cdd638470)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:04.005167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:04.006688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 567/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:03 2022] GET /identity/v3/roles/c2a695d1f64b4e0ea309282cdd638470 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:04.012898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:04.072364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:04.111061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb35f4-b614-4c67-9af2-5b0e3fc636c8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:04.143715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:04.144304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:04.144581 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:04.144850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] PATH_INFO: `/v3/users/b6ff004f168d4b13858ca0f2ae413a3f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:04.145951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff004f168d4b13858ca0f2ae413a3f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:04.147373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:04.148951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 560/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:04 2022] GET /identity/v3/users/b6ff004f168d4b13858ca0f2ae413a3f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:04.155279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:04.248639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890698a-1701-4b2c-a626-e19e6535cef8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:04.281031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:04.281616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:04.281892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:04.282160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:04.324874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:04.346297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:04.347721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:04.440077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 568/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:09:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:09:04.446046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:04.542953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a7e9-2b75-4087-aed1-87470fcdd6e4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:04.572466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:04.579181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e2e7-4c88-4062-9fa4-8dd1484981f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:04.579817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e2e7-4c88-4062-9fa4-8dd1484981f3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:04.580133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e2e7-4c88-4062-9fa4-8dd1484981f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:04.580414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e2e7-4c88-4062-9fa4-8dd1484981f3 None admin] PATH_INFO: `/v3/projects/233fb5b8302a4c6bb96b9315111c67d1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:04.581547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e2e7-4c88-4062-9fa4-8dd1484981f3 None admin] RBAC: Authorizing `identity:get_project(project_id=233fb5b8302a4c6bb96b9315111c67d1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:04.582995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e2e7-4c88-4062-9fa4-8dd1484981f3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:04.584987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 561/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:04 2022] GET /identity/v3/projects/233fb5b8302a4c6bb96b9315111c67d1 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:04.591006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:04.669048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:04.691726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15d8f-601f-46cc-ac17-5c084b347125 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:04.725455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:04.726070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:04.726354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:04.726629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:04.727355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] RBAC: Adding query filter params (role.id=c2a695d1f64b4e0ea309282cdd638470, scope.project.id=233fb5b8302a4c6bb96b9315111c67d1, user.id=b6ff004f168d4b13858ca0f2ae413a3f) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:04.727664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:04.729146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0db6e-c15a-4197-9d62-f70bedc59891 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:04.736297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 569/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:09:04 2022] GET /identity/v3/role_assignments?user.id=b6ff004f168d4b13858ca0f2ae413a3f&scope.project.id=233fb5b8302a4c6bb96b9315111c67d1&role.id=c2a695d1f64b4e0ea309282cdd638470 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:06.595098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0cac-57eb-4de3-925d-01429f3c72f7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:06.595626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0cac-57eb-4de3-925d-01429f3c72f7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:06.595626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0cac-57eb-4de3-925d-01429f3c72f7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:06.597048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 562/1131] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:06.602058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:06.602508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:06.602601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:06.621415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:06.622603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:06.686607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 570/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:06.958035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0cac-57eb-4de3-925d-01429f3c72f7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:07.057403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0cac-57eb-4de3-925d-01429f3c72f7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:07.090707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e01ffe-ee7f-4c1e-99dd-80bf9ab7766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:07.091327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e01ffe-ee7f-4c1e-99dd-80bf9ab7766e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:07.092219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e01ffe-ee7f-4c1e-99dd-80bf9ab7766e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:07.092501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e01ffe-ee7f-4c1e-99dd-80bf9ab7766e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:07.093609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e01ffe-ee7f-4c1e-99dd-80bf9ab7766e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:07.095047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e01ffe-ee7f-4c1e-99dd-80bf9ab7766e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:07.096624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 563/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:09:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:07.102289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:07.169105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:07.197161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43583a-a0b6-4dbb-a639-123b063901ba None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:07.230338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecca332-9728-4e18-9554-3991eafeb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:07.230883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecca332-9728-4e18-9554-3991eafeb2a8 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:07.231166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecca332-9728-4e18-9554-3991eafeb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:07.231444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecca332-9728-4e18-9554-3991eafeb2a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:07.232140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecca332-9728-4e18-9554-3991eafeb2a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:07.233582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecca332-9728-4e18-9554-3991eafeb2a8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:07.259003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 571/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:09:07 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:09:09.161759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112426-ab6a-427d-8422-943b74677e73 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:09.162258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112426-ab6a-427d-8422-943b74677e73 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:09.162258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112426-ab6a-427d-8422-943b74677e73 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:09.163574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 564/1135] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:09.168685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:09.169074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:09.169250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:09.187892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:09.189110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:09.253408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 572/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:09.519850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112426-ab6a-427d-8422-943b74677e73 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:09.584394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:09.619046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112426-ab6a-427d-8422-943b74677e73 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:09.651036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84888aad-a783-4efa-a99f-2d02c9ece40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:09.651649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84888aad-a783-4efa-a99f-2d02c9ece40a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:09.651927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84888aad-a783-4efa-a99f-2d02c9ece40a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:09.652227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84888aad-a783-4efa-a99f-2d02c9ece40a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:09.653328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84888aad-a783-4efa-a99f-2d02c9ece40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:09.655277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84888aad-a783-4efa-a99f-2d02c9ece40a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:09.656839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 565/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:09.662528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:09.715755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:09.760076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec53a7-a519-4ea3-9846-8be59a0a3240 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:09.792698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f372b-06a3-4406-8054-76d6feb6c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:09.793244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f372b-06a3-4406-8054-76d6feb6c3d6 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:09.793531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f372b-06a3-4406-8054-76d6feb6c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:09.793807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f372b-06a3-4406-8054-76d6feb6c3d6 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:09.794454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f372b-06a3-4406-8054-76d6feb6c3d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:09.796496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f372b-06a3-4406-8054-76d6feb6c3d6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:09.816215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 573/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:09:09 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:09:11.712870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a640-4a72-4be8-8c6a-b835d7c6742d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:11.713411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a640-4a72-4be8-8c6a-b835d7c6742d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:11.713411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a640-4a72-4be8-8c6a-b835d7c6742d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:11.714767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 566/1139] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:11.720692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:11.721088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:11.721253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:11.739168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:11.740386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:11.805275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 574/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:12.078920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a640-4a72-4be8-8c6a-b835d7c6742d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:12.176159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a640-4a72-4be8-8c6a-b835d7c6742d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:12.208588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:12.209196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:12.209472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:12.209741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:12.211516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:12.220350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:09:12.224943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:12.226057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:09:12.227109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 567/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:12.234406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:12.274056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:12.329693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8baa-6e51-4cc7-adc6-3d7502849410 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:12.361835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:12.362429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:12.362708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:12.362980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:12.363634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:12.363937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:12.365325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:12.373544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 575/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:12.379353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:12.475229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6b0d8-a36b-44de-9d7e-7cf7e8d4d46b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:12.508560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:12.509176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:12.509466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:12.509759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] PATH_INFO: `/v3/users/16b2760170894c96925b609646ce8976` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:12.522279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] RBAC: Authorizing `identity:get_user(user_id=16b2760170894c96925b609646ce8976)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:12.523717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:12.525320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 568/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:12 2022] GET /identity/v3/users/16b2760170894c96925b609646ce8976 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:12.531502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:12.627511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee39a4-7251-45e8-be23-9e8ab2fad1f6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:12.628936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:12.661535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:12.662131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:12.662409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:12.662678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:12.726595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:12.728066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:12.824192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 576/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:09:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:09:12.830077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:12.881202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:12.926905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af87a0-c730-439d-9c4b-48471126fafe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:12.959796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868508-47f9-4cd1-9012-b1862de85713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:12.960440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868508-47f9-4cd1-9012-b1862de85713 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:12.960720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868508-47f9-4cd1-9012-b1862de85713 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:12.960990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868508-47f9-4cd1-9012-b1862de85713 None admin] PATH_INFO: `/v3/projects/4e6e036ae3b446ada210181678090155` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:12.962087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868508-47f9-4cd1-9012-b1862de85713 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6e036ae3b446ada210181678090155)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:12.963519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868508-47f9-4cd1-9012-b1862de85713 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:12.965144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 569/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:12 2022] GET /identity/v3/projects/4e6e036ae3b446ada210181678090155 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:12.971631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:12.973784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:13.066307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525cdcc-2e73-421a-843b-d20120e8c39d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:13.099515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:13.100169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:13.100451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:13.100725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:13.101444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=4e6e036ae3b446ada210181678090155, user.id=16b2760170894c96925b609646ce8976) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:13.101755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:13.103182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180c81-54c8-4865-8040-1632061e5f60 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:13.108394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 577/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:09:12 2022] GET /identity/v3/role_assignments?user.id=16b2760170894c96925b609646ce8976&scope.project.id=4e6e036ae3b446ada210181678090155&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:14.949774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdea64-97e2-4205-b1eb-f171e73520a8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:14.950288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdea64-97e2-4205-b1eb-f171e73520a8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:14.950507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdea64-97e2-4205-b1eb-f171e73520a8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:14.952241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 570/1147] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:14.957496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:14.957889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:14.958062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:14.975513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:14.976729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:15.034285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:15.041738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 578/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:15.303652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdea64-97e2-4205-b1eb-f171e73520a8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:15.401655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdea64-97e2-4205-b1eb-f171e73520a8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:15.421213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:15.434771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:15.435914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:15.436348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:15.436622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:15.446535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:09:15.451209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:15.452329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:09:15.453418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 571/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:15.458184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:15.554260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb32dd-8e9b-4a1a-a762-017747d15ac4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:15.586046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:15.586639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:15.586917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:15.587189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:15.587840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:15.588171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:15.589540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:15.597686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 579/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:15.603225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:15.698919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cef65d-a154-41a8-aa98-54dbab908515 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:15.731419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:15.732636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:15.732915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:15.733185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] PATH_INFO: `/v3/users/16b2760170894c96925b609646ce8976` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:15.734311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] RBAC: Authorizing `identity:get_user(user_id=16b2760170894c96925b609646ce8976)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:15.735737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:15.737324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 572/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:15 2022] GET /identity/v3/users/16b2760170894c96925b609646ce8976 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:15.743237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:15.799301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:15.839108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaab59-4aa1-4f73-9328-37c2bec2d5ff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:15.871339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12466886-6ec1-4d52-b62a-457b03ad74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:15.871980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12466886-6ec1-4d52-b62a-457b03ad74db None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:15.872290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12466886-6ec1-4d52-b62a-457b03ad74db None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:15.872567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12466886-6ec1-4d52-b62a-457b03ad74db None admin] PATH_INFO: `/v3/projects/4e6e036ae3b446ada210181678090155` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:15.873662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12466886-6ec1-4d52-b62a-457b03ad74db None admin] RBAC: Authorizing `identity:get_project(project_id=4e6e036ae3b446ada210181678090155)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:15.875090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12466886-6ec1-4d52-b62a-457b03ad74db None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:15.876719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 580/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:15 2022] GET /identity/v3/projects/4e6e036ae3b446ada210181678090155 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:15.882591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:15.930649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:15.981056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b342c1-119f-45c6-a583-adfb28a48743 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:16.013503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1e266-9864-478a-a1b4-37f4be2e87e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:16.014152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e266-9864-478a-a1b4-37f4be2e87e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:16.014433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e266-9864-478a-a1b4-37f4be2e87e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:16.014703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e266-9864-478a-a1b4-37f4be2e87e1 None admin] PATH_INFO: `/v3/projects/4e6e036ae3b446ada210181678090155/users/16b2760170894c96925b609646ce8976/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:16.016689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1e266-9864-478a-a1b4-37f4be2e87e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e6e036ae3b446ada210181678090155, user_id=16b2760170894c96925b609646ce8976, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:16.018126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1e266-9864-478a-a1b4-37f4be2e87e1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:16.031537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 573/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:09:15 2022] PUT /identity/v3/projects/4e6e036ae3b446ada210181678090155/users/16b2760170894c96925b609646ce8976/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:09:17.892949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa95e5-1412-4377-aeaa-ca67bf901aeb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:17.893495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa95e5-1412-4377-aeaa-ca67bf901aeb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:17.893495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa95e5-1412-4377-aeaa-ca67bf901aeb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:17.894846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 581/1154] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:17.900124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:17.900558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:17.900681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:17.918764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:17.920569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:17.984910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 574/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:18.253639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa95e5-1412-4377-aeaa-ca67bf901aeb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:18.352996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa95e5-1412-4377-aeaa-ca67bf901aeb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:18.377198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:18.386007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:18.386624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:18.386898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:18.387167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:18.397301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:09:18.401923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:18.403102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:09:18.404865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 582/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:18.409641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:18.446940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:18.504486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8ed2e-2991-4900-8d16-b049751a458c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:18.537756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:18.538351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:18.538628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:18.538901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:18.539557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:18.539867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:18.541271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:18.549074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 575/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:09:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:18.554712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:18.651034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887820b0-672b-4e40-8349-d63f00f96fb9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:18.684217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:18.684875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:18.685157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:18.685434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] PATH_INFO: `/v3/users/16b2760170894c96925b609646ce8976` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:18.686530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=16b2760170894c96925b609646ce8976)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:18.687994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:18.689527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 583/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:18 2022] GET /identity/v3/users/16b2760170894c96925b609646ce8976 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:18.695494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:18.791186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:18.794598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767f0cf-ba7b-4a37-85c0-7f3a6bbc59fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:18.827169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:18.827771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:18.828089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:18.828363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:18.892992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:18.894425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:18.985097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:18.992717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 576/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:09:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:09:18.994557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:19.047744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:19.090083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2784-e355-4996-92fc-508c9fbde3c0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:19.122728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8219fe-dd20-4d9a-bb01-a74adbdd987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:19.123347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8219fe-dd20-4d9a-bb01-a74adbdd987b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:19.123626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8219fe-dd20-4d9a-bb01-a74adbdd987b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:19.123902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8219fe-dd20-4d9a-bb01-a74adbdd987b None admin] PATH_INFO: `/v3/projects/4e6e036ae3b446ada210181678090155` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:19.125024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8219fe-dd20-4d9a-bb01-a74adbdd987b None admin] RBAC: Authorizing `identity:get_project(project_id=4e6e036ae3b446ada210181678090155)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:19.126464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8219fe-dd20-4d9a-bb01-a74adbdd987b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:19.128089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 584/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:18 2022] GET /identity/v3/projects/4e6e036ae3b446ada210181678090155 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:19.134115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:19.230103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e581-1ee6-4216-925f-8781993590d3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:19.263403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:19.264048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:19.264336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:19.264612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:19.265336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=4e6e036ae3b446ada210181678090155, user.id=16b2760170894c96925b609646ce8976) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:19.265644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:19.267065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49766a6-30d2-4c51-b00b-889020b65594 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:19.272648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 577/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:09:19 2022] GET /identity/v3/role_assignments?user.id=16b2760170894c96925b609646ce8976&scope.project.id=4e6e036ae3b446ada210181678090155&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:21.145496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6bfd-6d27-4060-8531-fe05be103fac None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:21.146006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6bfd-6d27-4060-8531-fe05be103fac None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:21.146006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6bfd-6d27-4060-8531-fe05be103fac None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:21.147309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 585/1162] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:21.152507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:21.152884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:21.153109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:21.171247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:21.172474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:21.229118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:21.238663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 578/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:21.505337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6bfd-6d27-4060-8531-fe05be103fac None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:21.602821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6bfd-6d27-4060-8531-fe05be103fac None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:21.624540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:21.635810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:21.636426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:21.636704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:21.636972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:21.700789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:21.702217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:21.795508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 586/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:09:21.801372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:21.896397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823b5ac-1be8-410b-afb6-3a637b524106 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:21.928921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:21.929535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:21.929814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:21.930087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:21.936519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:21.937954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d4bf4166-ed37-4e62-89ce-39f43616a3ca None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:21.949169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:21.950900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:09:21.952058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 579/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:09:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:21.956523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:21.980148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:22.052499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78707ce-4639-4e4a-9cf8-8452666ad59f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:22.085680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:22.086282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:22.086566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:22.086843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:22.087485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:22.087790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:22.089565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdaec2-8ee7-42c2-b340-a9f847aa0fe9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:22.097663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 587/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 17 14:09:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:23.955832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30474f-dae8-441b-a81d-b5c52ac442e5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:23.956484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30474f-dae8-441b-a81d-b5c52ac442e5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:23.956484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30474f-dae8-441b-a81d-b5c52ac442e5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:23.957759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 580/1167] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:23.963057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af9251-083d-4303-b40b-7f70aa51d7c6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:23.963491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af9251-083d-4303-b40b-7f70aa51d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:23.963628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af9251-083d-4303-b40b-7f70aa51d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:23.982659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a5af9251-083d-4303-b40b-7f70aa51d7c6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:23.983840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a5af9251-083d-4303-b40b-7f70aa51d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:24.047574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 588/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:24.321589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30474f-dae8-441b-a81d-b5c52ac442e5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:24.376038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:24.421202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30474f-dae8-441b-a81d-b5c52ac442e5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:24.453517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702211cc-93d6-42ae-96fd-2c1a35f33c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:24.454101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702211cc-93d6-42ae-96fd-2c1a35f33c21 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:24.454376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702211cc-93d6-42ae-96fd-2c1a35f33c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:24.454642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702211cc-93d6-42ae-96fd-2c1a35f33c21 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:24.455277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702211cc-93d6-42ae-96fd-2c1a35f33c21 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:24.456664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702211cc-93d6-42ae-96fd-2c1a35f33c21 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:24.471922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 581/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Wed Aug 17 14:09:24 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:09:26.369573 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dce92-f10b-40a9-9bb1-c04672ea9967 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:26.370120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dce92-f10b-40a9-9bb1-c04672ea9967 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:26.370120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dce92-f10b-40a9-9bb1-c04672ea9967 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:26.371985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 589/1170] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:26.377170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:26.377546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:26.377732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:26.395938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:26.397161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:26.461958 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 582/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:26.730103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dce92-f10b-40a9-9bb1-c04672ea9967 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:26.749174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:26.831114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dce92-f10b-40a9-9bb1-c04672ea9967 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:26.864231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017a45-f8fe-49ef-9a04-7e81ec0d370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:26.864853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017a45-f8fe-49ef-9a04-7e81ec0d370e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:26.865132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017a45-f8fe-49ef-9a04-7e81ec0d370e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:26.865406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017a45-f8fe-49ef-9a04-7e81ec0d370e None admin] PATH_INFO: `/v3/domains/c23fa62299f54d58a58450e98f81d368` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:26.875362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017a45-f8fe-49ef-9a04-7e81ec0d370e None admin] RBAC: Authorizing `identity:get_domain(domain_id=c23fa62299f54d58a58450e98f81d368)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:26.876829 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017a45-f8fe-49ef-9a04-7e81ec0d370e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:26.878395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 590/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Aug 17 14:09:26 2022] GET /identity/v3/domains/c23fa62299f54d58a58450e98f81d368 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:26.884308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:26.928542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:26.981895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a22f-7f85-42ab-9125-38a53ece292d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:27.014049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c65a84-5339-44ff-a985-f1801b161126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:27.014651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65a84-5339-44ff-a985-f1801b161126 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:27.014931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65a84-5339-44ff-a985-f1801b161126 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:27.015203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65a84-5339-44ff-a985-f1801b161126 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:27.015835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c65a84-5339-44ff-a985-f1801b161126 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:27.017295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c65a84-5339-44ff-a985-f1801b161126 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:27.042708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 583/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:09:26 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:09:28.926418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a87a4-9cce-415a-b155-9e1596459539 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:28.926944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a87a4-9cce-415a-b155-9e1596459539 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:28.927125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a87a4-9cce-415a-b155-9e1596459539 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:28.928339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 591/1174] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:28.933341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:28.933777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:28.934505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:28.952270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:28.953444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:29.016822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 584/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:29.286418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a87a4-9cce-415a-b155-9e1596459539 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:29.362959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:29.386104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a87a4-9cce-415a-b155-9e1596459539 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:29.418730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261330c0-6088-4893-a0db-3d082b31d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:29.419352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261330c0-6088-4893-a0db-3d082b31d960 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:29.419633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261330c0-6088-4893-a0db-3d082b31d960 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:29.419910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261330c0-6088-4893-a0db-3d082b31d960 None admin] PATH_INFO: `/v3/domains/c23fa62299f54d58a58450e98f81d368` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:29.421047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261330c0-6088-4893-a0db-3d082b31d960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c23fa62299f54d58a58450e98f81d368)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:29.422484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261330c0-6088-4893-a0db-3d082b31d960 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:29.424194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 592/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Aug 17 14:09:29 2022] GET /identity/v3/domains/c23fa62299f54d58a58450e98f81d368 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:29.429666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:29.456224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:29.526444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7c57-ee97-4f0d-a394-c17fcd83b8cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:29.558999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f3e0-8362-41ab-824f-b7ea97e9cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:29.559544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f3e0-8362-41ab-824f-b7ea97e9cf4b None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:29.559823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f3e0-8362-41ab-824f-b7ea97e9cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:29.560123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f3e0-8362-41ab-824f-b7ea97e9cf4b None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:29.560762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f3e0-8362-41ab-824f-b7ea97e9cf4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:29.562191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f3e0-8362-41ab-824f-b7ea97e9cf4b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:29.582526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 585/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:09:29 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:09:31.474774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eede4c-dd26-4bf6-9e34-a658f0ee0b9d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:31.475304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eede4c-dd26-4bf6-9e34-a658f0ee0b9d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:31.475304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eede4c-dd26-4bf6-9e34-a658f0ee0b9d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:31.476682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 593/1178] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:31.482436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:31.482813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:31.482992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:31.500636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:31.501827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:31.567180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 586/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:31.833852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eede4c-dd26-4bf6-9e34-a658f0ee0b9d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:31.931894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eede4c-dd26-4bf6-9e34-a658f0ee0b9d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:31.964761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:31.965992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:31.966271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:31.966540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:31.976227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:09:31.981683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:31.982828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:09:31.983767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 594/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:31.988668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:32.003018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:32.086535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4da45-3984-4475-bcff-f84b6e0bb17d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:32.119643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:32.120268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:32.120548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:32.120817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:32.121529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:32.121826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:32.123184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:32.130808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 587/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:32.136539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:32.140900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:32.242908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045b68f-958d-4719-916f-387d87b74d2e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:32.274937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:32.275503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:32.275783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:32.276087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] PATH_INFO: `/v3/users/0493b0cf684345b8989fb5cf60af38cf` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:32.288935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] RBAC: Authorizing `identity:get_user(user_id=0493b0cf684345b8989fb5cf60af38cf)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:32.290369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:32.291967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 595/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:32 2022] GET /identity/v3/users/0493b0cf684345b8989fb5cf60af38cf => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:32.298389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:32.370984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:32.396158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965ba7-ebb1-45de-98e2-f046ba2385db None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:32.428334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:32.428925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:32.429202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:32.429469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:32.493675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:32.495106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:32.564062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:32.589399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 588/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:09:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:09:32.595731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:32.655016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:32.691779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223a915-ebf4-4ec9-89f0-b3885cae3253 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:32.724735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0b599-0404-4051-92ce-8c53bd8d278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:32.725353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0b599-0404-4051-92ce-8c53bd8d278f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:32.725639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0b599-0404-4051-92ce-8c53bd8d278f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:32.725915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0b599-0404-4051-92ce-8c53bd8d278f None admin] PATH_INFO: `/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:32.727023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0b599-0404-4051-92ce-8c53bd8d278f None admin] RBAC: Authorizing `identity:get_project(project_id=7851b4c2792d48c6b4d6b3165cb46a00)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:32.728492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0b599-0404-4051-92ce-8c53bd8d278f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:32.730125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 596/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:32 2022] GET /identity/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:32.736204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:32.832717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c510-60ad-4cc8-b593-482bd85d968b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:32.864522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:32.865125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:32.865408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:32.865683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:32.866487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=7851b4c2792d48c6b4d6b3165cb46a00, user.id=0493b0cf684345b8989fb5cf60af38cf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:32.866801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:32.868319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f866a9d-4799-42c8-a21b-2593da57a666 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:32.874858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 589/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:09:32 2022] GET /identity/v3/role_assignments?user.id=0493b0cf684345b8989fb5cf60af38cf&scope.project.id=7851b4c2792d48c6b4d6b3165cb46a00&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:34.700443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bcd8f-e35d-49bd-826e-f818ad59c527 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:34.700990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bcd8f-e35d-49bd-826e-f818ad59c527 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:34.700990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bcd8f-e35d-49bd-826e-f818ad59c527 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:34.702333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 597/1186] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:34.707420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:34.707827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:34.707980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:34.725412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:34.726579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:34.757143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:34.794137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 590/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:35.064591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bcd8f-e35d-49bd-826e-f818ad59c527 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:35.162120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bcd8f-e35d-49bd-826e-f818ad59c527 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:35.189369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:35.195362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:35.196000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:35.196285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:35.196555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:35.206162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:09:35.210795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:35.211867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:09:35.212979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 598/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:35.218336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:35.312821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9a712-26f0-482d-85d8-6b8d517feb03 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:35.346080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:35.346614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:35.346895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:35.347168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:35.347826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:35.348155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:35.349517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:35.357668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 591/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:35.363177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:35.460716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f7ab7-823c-4444-b1ea-92b77a76df4b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:35.492587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:35.493198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:35.493478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:35.493752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] PATH_INFO: `/v3/users/0493b0cf684345b8989fb5cf60af38cf` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:35.494849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] RBAC: Authorizing `identity:get_user(user_id=0493b0cf684345b8989fb5cf60af38cf)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:35.496839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:35.498377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 599/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:35 2022] GET /identity/v3/users/0493b0cf684345b8989fb5cf60af38cf => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:35.503827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:35.533180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:35.599910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23f26-8be1-455b-8894-7f9ed6d0c975 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:35.632295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0790f-ebf1-4a66-83ab-be8554580f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:35.632911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0790f-ebf1-4a66-83ab-be8554580f96 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:35.633190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0790f-ebf1-4a66-83ab-be8554580f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:35.633461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0790f-ebf1-4a66-83ab-be8554580f96 None admin] PATH_INFO: `/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:35.634558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0790f-ebf1-4a66-83ab-be8554580f96 None admin] RBAC: Authorizing `identity:get_project(project_id=7851b4c2792d48c6b4d6b3165cb46a00)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:35.636031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0790f-ebf1-4a66-83ab-be8554580f96 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:35.637640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 592/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:35 2022] GET /identity/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:35.643309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:35.699436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:35.739891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496c748-c5ec-4d75-b8ba-350efd20890a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:35.772278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be54be-6d9f-4980-bb4e-3a62c338779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:35.772919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be54be-6d9f-4980-bb4e-3a62c338779c None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:35.773194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be54be-6d9f-4980-bb4e-3a62c338779c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:35.773462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be54be-6d9f-4980-bb4e-3a62c338779c None admin] PATH_INFO: `/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00/users/0493b0cf684345b8989fb5cf60af38cf/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:35.775291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be54be-6d9f-4980-bb4e-3a62c338779c None admin] RBAC: Authorizing `identity:create_grant(project_id=7851b4c2792d48c6b4d6b3165cb46a00, user_id=0493b0cf684345b8989fb5cf60af38cf, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:35.776759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be54be-6d9f-4980-bb4e-3a62c338779c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:35.789239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 600/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:09:35 2022] PUT /identity/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00/users/0493b0cf684345b8989fb5cf60af38cf/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:09:37.641157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dc6f5-0b5e-401e-b744-a58827a8812e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:37.641704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dc6f5-0b5e-401e-b744-a58827a8812e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:37.641704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dc6f5-0b5e-401e-b744-a58827a8812e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:37.643053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 593/1193] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:09:37.648301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:37.648730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:37.648855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:37.666386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:09:37.667557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:09:37.731041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 601/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:09:38.002315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dc6f5-0b5e-401e-b744-a58827a8812e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:38.098121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:38.103281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dc6f5-0b5e-401e-b744-a58827a8812e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:38.137868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:38.138488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:38.138770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:38.139045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:38.148931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:09:38.153683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:09:38.154797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:09:38.155827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 594/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:09:38.160783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:38.214157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:38.264379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b68e-e69a-41b3-9121-5cdc2f1e0d93 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:38.296110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:38.296709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:38.296988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:38.297259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:38.297917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:38.298219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:38.299580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:38.307236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 602/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:38.313607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:38.409647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e889043-2629-4d4f-ac10-a235d6c0b64c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:38.442536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:38.443155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:38.443436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:38.443711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] PATH_INFO: `/v3/users/0493b0cf684345b8989fb5cf60af38cf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:38.444852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] RBAC: Authorizing `identity:get_user(user_id=0493b0cf684345b8989fb5cf60af38cf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:38.446278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:38.447835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 595/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Aug 17 14:09:38 2022] GET /identity/v3/users/0493b0cf684345b8989fb5cf60af38cf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:38.454057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:38.552033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd899d6d-2494-459d-85cd-9ed1c43938b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:38.561777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:38.584785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:38.585380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:38.585660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:38.585933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:38.649873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:38.651299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:38.747811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 603/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:09:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:09:38.753616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:38.781020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:38.851341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f1ce-938e-41db-89e9-9a5b86671725 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:38.884284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb908f-fa4f-4ec8-92ca-1717dbc37ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:38.884908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb908f-fa4f-4ec8-92ca-1717dbc37ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:38.885192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb908f-fa4f-4ec8-92ca-1717dbc37ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:38.885468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb908f-fa4f-4ec8-92ca-1717dbc37ad7 None admin] PATH_INFO: `/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:38.886606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb908f-fa4f-4ec8-92ca-1717dbc37ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=7851b4c2792d48c6b4d6b3165cb46a00)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:38.888065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb908f-fa4f-4ec8-92ca-1717dbc37ad7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:38.889672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 596/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Aug 17 14:09:38 2022] GET /identity/v3/projects/7851b4c2792d48c6b4d6b3165cb46a00 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:38.895706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:09:38.907315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:38.990992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1872d9-e1a3-4faa-97d4-c17fba897867 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:09:39.023212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:09:39.023801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:09:39.024116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:09:39.024393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:09:39.025109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=7851b4c2792d48c6b4d6b3165cb46a00, user.id=0493b0cf684345b8989fb5cf60af38cf) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:09:39.025418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:09:39.026841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5352-ac12-4224-9942-d41e9fd66046 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:09:39.032955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 604/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:09:38 2022] GET /identity/v3/role_assignments?user.id=0493b0cf684345b8989fb5cf60af38cf&scope.project.id=7851b4c2792d48c6b4d6b3165cb46a00&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:09:48.880241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=53 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:09:49.030509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=63 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:33.915702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b922a8-9b2b-475c-8867-c99fc5f059d4 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:33.916325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b922a8-9b2b-475c-8867-c99fc5f059d4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:33.916325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b922a8-9b2b-475c-8867-c99fc5f059d4 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:33.917628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 597/1201] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:10:33.927997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:33.927997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:33.927997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:33.947455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:33.949062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:34.029665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 605/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:10:34.369091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b922a8-9b2b-475c-8867-c99fc5f059d4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:34.511986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b922a8-9b2b-475c-8867-c99fc5f059d4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:34.572988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:34.573762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:34.574148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:34.574430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:34.590122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:34.591830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:34.613825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:34.616261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:34.617285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:34.617285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:34.617285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:34.617285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 598/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:34.621462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:34.745412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3e3a9-9560-436f-913b-52c12a5a22df None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:34.787985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:34.794365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:34.794982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:34.795288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:34.795559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:34.796293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:34.796666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:34.797974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195a2d9-f87a-42d2-ac02-65b6af25a1f0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:34.810926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 606/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:34.817216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:34.886818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:34.944169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eccec-0f4f-4ea7-90dd-159c91438212 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:34.980083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e42eb-4156-4a65-8b8b-3f4aed3d3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:34.981086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e42eb-4156-4a65-8b8b-3f4aed3d3376 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:34.981324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e42eb-4156-4a65-8b8b-3f4aed3d3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:34.981677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e42eb-4156-4a65-8b8b-3f4aed3d3376 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:34.982398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e42eb-4156-4a65-8b8b-3f4aed3d3376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:34.983919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e42eb-4156-4a65-8b8b-3f4aed3d3376 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:35.008781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 599/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Aug 17 14:10:34 2022] POST /identity/v3/users => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:10:37.378178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bead2-62d8-4f68-9a29-5f6b9113408a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:37.378178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bead2-62d8-4f68-9a29-5f6b9113408a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:37.378178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bead2-62d8-4f68-9a29-5f6b9113408a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:37.378178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 607/1206] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:10:37.384993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:37.386313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:37.386313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:37.405167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:37.406374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:37.482248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 600/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:10:37.800830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bead2-62d8-4f68-9a29-5f6b9113408a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:37.921776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bead2-62d8-4f68-9a29-5f6b9113408a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:37.966793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:37.967499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:37.967928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:37.968815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:37.981899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:10:37.987129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:37.988141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:37.988987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 608/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:10:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:37.994888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:38.038065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:38.109902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef228-d8db-4d36-a8cd-bfdbead1bd03 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:38.148896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:38.149577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:38.149891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:38.150171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:38.150984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:38.151369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:38.153108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:38.162330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 601/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:10:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:38.169861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:38.230763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:38.291756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13194869-27e7-402e-8144-8546213bfce9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:38.330770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:38.331446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:38.331759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:38.332072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:38.345259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:38.346725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:38.364000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:38.365274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:38.366632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:38.366632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:38.366632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:38.372275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 609/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:38.373649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:38.493175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:38.498209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193c68-789f-405f-ba04-2ba9c8686002 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:38.537916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:38.538831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:38.538951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:38.539191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:38.539882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:38.540217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:38.541740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:38.559433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 602/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:38.564115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:38.680207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d5f2e-632c-4a92-aeae-e8fc44a033dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:38.681938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:38.719350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:38.720020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:38.720419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:38.720732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:38.729564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:38.731126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:10:38.742827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:38.744027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:38.751594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 610/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:10:38.752931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:38.870802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12c8b-5917-422b-bd92-ae42adca7f48 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:38.911632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:38.912534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:38.912721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:38.912966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:38.914205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:38.914582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:38.916202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:38.937791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 603/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Aug 17 14:10:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:38.944102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:39.062762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af7278-16ec-44e1-9b1e-68a6d9bed541 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:39.104847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:39.105562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:39.105973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:39.106258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:39.142855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:39.188100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:39.189912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:39.291945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 611/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:10:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 14:10:39.297465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:39.317885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:39.406766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217e67b-0b50-4b29-bbb6-9ce16298a582 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:39.449458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:39.450231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:39.450627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:39.450908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:39.463506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:39.465247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:39.481690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:39.482896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:39.483912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:39.483912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:39.483912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:39.487705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 604/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:39.488721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:39.559103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:39.600475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025d5ca-9bef-43b9-8065-764e993b5a46 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:39.636814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:39.637497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:39.637808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:39.638086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:39.638819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:39.639156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:39.640804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:39.659510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 612/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:10:39.660931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:39.738994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:39.775631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd49ce-752e-49f3-96bd-263014e9c119 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:39.814124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:39.820009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:39.820009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:39.820009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:39.824169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:39.824655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:10:39.839530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:39.841047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:39.842156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:39.846014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 605/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:10:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:39.847686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:39.975380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daf39e-2554-41bf-a612-286dc3b6ff99 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:40.000714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:40.013571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:40.014216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:40.014481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:40.014746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:40.015423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:40.015726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:40.017193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b930fb-d11c-43f0-9b6d-3dbb14b5b9a5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:40.030849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 613/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:10:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:40.037054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:40.146084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf3b3-e5a3-46a5-9c10-f3bcb35b3216 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:40.183438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:40.190625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:40.191342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:40.191518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:40.191779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:40.192575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=70af8d78a61a4155a37c330b19123a8d) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:40.192866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:40.194350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2014a75-92e8-4a28-97cc-dadbd982d615 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:40.200526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 606/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:10:40 2022] GET /identity/v3/role_assignments?user.id=70af8d78a61a4155a37c330b19123a8d&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:42.138507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887e85-accd-41f4-8f1a-56476dc07d83 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:42.139056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887e85-accd-41f4-8f1a-56476dc07d83 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:42.139172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887e85-accd-41f4-8f1a-56476dc07d83 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:42.140809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 614/1220] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:10:42.147048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:42.147553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:42.147879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:42.170006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:42.171214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:42.242826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 607/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 14:10:42.529514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f887e85-accd-41f4-8f1a-56476dc07d83 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:42.642120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f887e85-accd-41f4-8f1a-56476dc07d83 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:42.678994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:42.679710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:42.680066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:42.680386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:42.691376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:10:42.696921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:42.697958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:42.698797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 615/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:42.704165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:42.810939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b05269-6ae9-44cf-8d7d-12edaff25aee None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:42.836951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:42.852637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:42.853300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:42.853567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:42.853880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:42.854627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:42.854960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:42.856473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:42.865084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 608/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:42.870893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:42.918112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:42.979671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004c11f-3883-41f2-9c03-c6c0db57c4d0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:43.014448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:43.015227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:43.015543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:43.015884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:43.027545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:43.029212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:43.045369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:43.046543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:43.047433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:43.047433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:43.047433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:43.047433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 616/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:10:43.052296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:43.162045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51137826-4dfa-4c2d-b7fa-543912bf6d4f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:43.201487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:43.202090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:43.202368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:43.202637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:43.203315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:43.203619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:43.205063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:43.217992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 609/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:43.223512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:43.325284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:43.332408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874017d-59fd-4a15-b8a9-311bfb5c3347 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:43.367606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:43.368272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:43.368555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:43.368828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:43.377182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:43.378626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:10:43.390146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:43.391400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:43.392553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 617/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:43.400267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:43.449336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:43.509493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c96d-cf02-416f-b7de-73272d5b97a6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:43.545023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:43.545627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:43.545909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:43.546183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:43.546909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:43.547214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:43.548692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:43.571568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 610/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Aug 17 14:10:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:43.573088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:43.684796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7f9d5-ace3-43e2-98e1-eb17569010ee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:43.719835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:43.720465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:43.720808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:43.721116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:43.734407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:43.735857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:43.750311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:43.751332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:43.752244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:43.752244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:43.752244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:43.752244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 618/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:43.757413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:43.870940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600467d0-1bb5-4061-ad6a-687e004737aa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:43.873592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:43.910847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d51b2-be76-4200-b61d-750134300008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:43.911520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d51b2-be76-4200-b61d-750134300008 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:43.911807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d51b2-be76-4200-b61d-750134300008 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:43.912148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d51b2-be76-4200-b61d-750134300008 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:43.912832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d51b2-be76-4200-b61d-750134300008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:43.913223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d51b2-be76-4200-b61d-750134300008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:43.915182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d51b2-be76-4200-b61d-750134300008 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:43.932010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 611/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:43.933285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:43.943793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:44.045819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0c7b4-7f49-4695-9a90-e2719aa14f0b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:44.079519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:44.080175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:44.080459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:44.080728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:44.089159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:44.090598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:10:44.105621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:44.106568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:44.107875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 619/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:44.113932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d51b2-be76-4200-b61d-750134300008 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:44.243673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d51b2-be76-4200-b61d-750134300008 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:44.281039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:44.281836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:44.282144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:44.282534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:44.283288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:44.283673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:44.285428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2947c-a53a-476a-b160-ff132d42d5ac None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:44.300311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 612/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:44.306721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:44.378285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:44.417034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ba2fe-7abb-480a-8235-25512527837f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:44.451209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82308a-8d14-4370-9a7c-f49f89b0ffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:44.451861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82308a-8d14-4370-9a7c-f49f89b0ffd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:44.452173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82308a-8d14-4370-9a7c-f49f89b0ffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:44.452449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82308a-8d14-4370-9a7c-f49f89b0ffd9 None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/70af8d78a61a4155a37c330b19123a8d/roles/1856823e00b043c78e43efdd6d9a6cd1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:44.467211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82308a-8d14-4370-9a7c-f49f89b0ffd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=70af8d78a61a4155a37c330b19123a8d, role_id=1856823e00b043c78e43efdd6d9a6cd1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:44.468706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82308a-8d14-4370-9a7c-f49f89b0ffd9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:44.482698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 620/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:10:44 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/70af8d78a61a4155a37c330b19123a8d/roles/1856823e00b043c78e43efdd6d9a6cd1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:10:46.481010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c6a04-0d8e-43c1-9f41-470524b216b7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:46.481564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c6a04-0d8e-43c1-9f41-470524b216b7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:46.481564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c6a04-0d8e-43c1-9f41-470524b216b7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:46.483086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 613/1233] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:10:46.488910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:46.489306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:46.489472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:46.509627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:46.510929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:46.585855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 621/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:10:46.856824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c6a04-0d8e-43c1-9f41-470524b216b7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:46.884744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:46.971241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c6a04-0d8e-43c1-9f41-470524b216b7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:47.010799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:47.011354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:47.011629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:47.011898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:47.024215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:10:47.029534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:47.030655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:47.031495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 614/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Aug 17 14:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:47.036775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:47.088405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:47.149514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418b3c4-a1b7-41f9-8e61-c59d4a7fb22f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:47.191560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:47.192210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:47.192510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:47.192766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:47.193446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:47.193730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:47.195633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:47.204833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 622/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Aug 17 14:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:10:47.211268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:47.302330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:47.320617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875974e-daa1-41ba-b5e5-36cdf813989f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:47.356745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:47.357436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:47.357769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:47.358141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:47.369365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:47.370891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:47.387398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:47.388554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:47.389430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:47.389430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:47.389430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:47.389430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 615/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:47.395100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:47.505562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3709a-207c-4436-81b7-16a4dd562788 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:47.516294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:47.545032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:47.545724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:47.546090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:47.546380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:47.547113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:47.547467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:47.549038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:47.563428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 623/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:47.570060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:47.679335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824b16-1631-4885-9487-bd6c560e13ba None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:47.719039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:47.719718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:47.720028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:47.720304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:47.724523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:47.732018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:47.732018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:10:47.746699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:47.747749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:47.748705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 616/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:10:47.753813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:47.875696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a8ca-51a5-47a7-90d2-820c788f60b8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:47.914339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:47.915053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:47.915380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:47.915705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:47.916713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:47.917031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:47.918467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:47.937350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 624/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Aug 17 14:10:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:47.943366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:48.059720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0a6df-66ab-4c9b-964e-ae13477bf568 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:48.098830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:48.099501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:48.099806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:48.100225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:48.173763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:48.186306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:48.188038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:48.301947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 617/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:10:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:10:48.308585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:48.339668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:48.421597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e380d-5c55-44b8-a344-bdd25a814065 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:48.459061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:48.459660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:48.460044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:48.460326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:48.471582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:48.473457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:48.488720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:48.490215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:48.492088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:48.492088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:48.492088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:48.492088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 625/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:48.496754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:48.603479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:48.609940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2932-6c0a-47d9-94b2-8daf9a68e5a6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:48.644981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:48.645590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:48.645864 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:48.646134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:48.646775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:48.647074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:48.648483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:48.660164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 618/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:48.668364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:48.752371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:48.774464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76d160-037c-4b42-96cb-e974e070afbb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:48.811283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:48.812125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:48.812476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:48.812777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:48.820763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:48.822241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:10:48.834073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:48.835708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:48.836827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 626/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:10:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:48.841821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:48.958676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0229-152a-4f0d-97ae-614d10e00756 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:48.997225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:48.997712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:48.998055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:48.998334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:48.999049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:48.999340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:49.000829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a75870-fbb4-46da-ba6c-1259da4ccb82 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:49.014866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 619/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:49.021513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:49.131203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900e65-206d-4498-9772-f6f5cdb03faa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:49.171854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:49.172916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:49.173238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:49.173661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:49.174779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] RBAC: Adding query filter params (role.id=1856823e00b043c78e43efdd6d9a6cd1, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=70af8d78a61a4155a37c330b19123a8d) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:49.175129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:49.177709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7fda8-7f8a-40f4-8d27-3659c352f6a9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:49.186998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 627/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:10:49 2022] GET /identity/v3/role_assignments?user.id=70af8d78a61a4155a37c330b19123a8d&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=1856823e00b043c78e43efdd6d9a6cd1 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:51.368239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532c01-e30e-4b56-b1ac-30b23ca69760 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:51.368769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532c01-e30e-4b56-b1ac-30b23ca69760 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:51.368859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532c01-e30e-4b56-b1ac-30b23ca69760 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:51.370319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 620/1247] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:10:51.376610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:51.377300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:51.377300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:51.383594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:51.398642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:51.399904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:51.474806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 628/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:10:51.741551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532c01-e30e-4b56-b1ac-30b23ca69760 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:51.760370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:51.854988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532c01-e30e-4b56-b1ac-30b23ca69760 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:51.894511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:51.895228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:51.895586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:51.895893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:51.906617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:10:51.911896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:51.913722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:51.915136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 621/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:51.919710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:52.030475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c42a7-eb1e-454b-82b8-0be87c6db84d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:52.063104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:52.069431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:52.070197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:52.070496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:52.070802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:52.071611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:52.072047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:52.073420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:52.081668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 629/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:52.088064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:52.185383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:52.217937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d6431-2125-41dc-89c1-f1b946ea86ef None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:52.253984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:52.254682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:52.254960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:52.255231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:52.266430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:52.268147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:52.285195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:52.286279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:52.287486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:52.287486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:52.287486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:52.287486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 622/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:52.293293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:52.403357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d457b-3df1-4f86-948f-3dd75d74a920 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:52.450871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224404f-5909-4753-908b-318d8d390215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:52.451558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224404f-5909-4753-908b-318d8d390215 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:52.451861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224404f-5909-4753-908b-318d8d390215 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:52.452223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224404f-5909-4753-908b-318d8d390215 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:52.452893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224404f-5909-4753-908b-318d8d390215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:52.453305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224404f-5909-4753-908b-318d8d390215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:52.454880 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224404f-5909-4753-908b-318d8d390215 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:52.468722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 630/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:52.475006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:52.580949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5614-8144-4cc3-b1e4-aa563b85f3dc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:52.607828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:52.615922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:52.617541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:52.617922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:52.618207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:52.627550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:52.629031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:10:52.642373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:52.643544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:52.644666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 623/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:52.650113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224404f-5909-4753-908b-318d8d390215 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:52.711614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:52.764971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224404f-5909-4753-908b-318d8d390215 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:52.800857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:52.801473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:52.801753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:52.802037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:52.802752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:52.803056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:52.805088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:52.826214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 631/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Aug 17 14:10:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:52.832739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:52.939585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f177-542b-4b8a-b596-2ecb470d844d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:52.973596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:52.974200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:52.975818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:52.976124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:53.034573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:53.051588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:53.053387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:53.170095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 624/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:10:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:10:53.172769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:53.284801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad91b-7109-4f2d-ad59-5baf3a24fb88 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:53.298478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:53.321144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:53.321794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:53.322072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:53.322340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:53.333477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:53.335554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:53.350694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:53.351859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:53.353184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:53.353184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:53.353184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:53.353184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 632/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:53.357735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:53.449067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:53.463634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874233e-e002-4b1e-a7ae-3199abbb9150 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:53.499048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:53.499691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:53.499916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:53.500247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:53.500883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:53.501183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:53.502536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:53.514177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 625/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:53.519624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:53.618401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716349f1-5ba2-469d-be94-0e69c66d5d25 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:53.653011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:53.653649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:53.653921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:53.654189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:53.661749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:53.663819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:10:53.675665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:53.676825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:10:53.677914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 633/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:53.682905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:53.780666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c54eb-e303-40e4-bdd5-4dfab57c5698 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:53.812533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:53.813131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:53.813407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:53.813730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:53.814608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:53.814908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:53.816360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e59817-6b51-40a2-84c1-1d69d8c233e3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:53.828315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 626/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:53.834463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:53.859276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:53.930686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7aa1-6b2b-4c7a-b66f-ddc1a0493e2c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:53.962191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:53.962770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:53.963046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:53.963312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:53.964044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=70af8d78a61a4155a37c330b19123a8d) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:53.964354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:53.965768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b257-e581-4a9a-ad15-b92f7dc3822c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:53.970888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 634/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:10:53 2022] GET /identity/v3/role_assignments?user.id=70af8d78a61a4155a37c330b19123a8d&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:55.817330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500193-a9da-4c03-bc68-e81a4fb6f739 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:55.817779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500193-a9da-4c03-bc68-e81a4fb6f739 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:55.817890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500193-a9da-4c03-bc68-e81a4fb6f739 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:55.819766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 627/1261] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:10:55.824806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:55.825170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:55.825361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:55.842894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:55.844102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:55.908033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 635/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:10:56.180440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500193-a9da-4c03-bc68-e81a4fb6f739 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:56.191937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:56.284535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500193-a9da-4c03-bc68-e81a4fb6f739 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:56.316380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:56.316994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:56.317269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:56.317535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:56.327617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:10:56.332378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:56.333500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:56.335202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 628/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:56.340124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:56.357644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:56.434359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb5dd-2a6e-4a54-ad84-5275b0e54728 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:56.467038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:56.467628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:56.467903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:56.468200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:56.468852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:56.469149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:56.470504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:56.478138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 636/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:56.483705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:56.548709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:56.579850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93269-31b8-4779-95fd-9eb25e7689ea None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:56.612833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:56.613439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:56.613711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:56.613982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:56.623636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:56.625098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:56.638867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:56.639987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:56.641090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:56.641090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:56.641090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:56.641090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 629/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:56.645762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:56.724428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:56.744566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082d287-190b-42c1-b364-51846e98ed44 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:56.776529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:56.777120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:56.777398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:56.777675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:56.778307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:56.778609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:56.779985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:56.791045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 637/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:56.796786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:56.893865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef552b-9811-4c14-95ad-c39490ec424f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:56.914063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:56.928769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:56.929389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:56.929670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:56.929942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:56.936631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:56.938060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:10:56.949397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:56.950327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:56.951339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 630/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:56.956322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:57.052025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30373725-3dfe-432e-914b-ca5c18d08bca None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:57.085527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:57.086120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:57.086402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:57.086675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:57.087393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:57.087698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:57.089157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:57.097358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:57.106050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 638/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Aug 17 14:10:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:57.111545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:57.222359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86670-5852-4069-80ea-421afaca6839 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:57.254313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:57.254929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:57.255206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:57.255475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:57.265998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:57.267432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:10:57.280788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:57.281871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:10:57.282761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:10:57.282761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:10:57.282761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:57.282761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 631/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:57.287785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:57.384107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089a1ab-9b32-431d-83cd-6ef314aa6f08 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:57.416307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:57.416896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:57.417175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:57.417447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:57.418077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:57.418378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:57.419741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:57.431423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 639/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:57.436876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:57.468108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:57.534704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116579e-87f5-4620-aafe-9e4dafcdd53b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:57.567039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:57.567653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:57.567932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:57.568234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:57.575095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:57.576568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:10:57.587327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:10:57.588247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:10:57.589313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 632/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:10:57.594184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:57.650628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:57.692283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e9a4-3879-4e85-a632-4ae460dcb23d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:57.723935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:57.724563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:57.725342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:57.725615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:57.726304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:10:57.726610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:57.728061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951555-4b83-4d83-95b0-52403a924fdd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:57.739937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 640/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:10:57.746367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:10:57.835707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:10:57.844914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2447cd-e84f-45a4-9740-87906fa03800 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:10:57.876519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e8188-6de1-4044-82ad-0d9ff55c46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:10:57.877158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e8188-6de1-4044-82ad-0d9ff55c46aa None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:57.877438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e8188-6de1-4044-82ad-0d9ff55c46aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:57.877713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e8188-6de1-4044-82ad-0d9ff55c46aa None admin] PATH_INFO: `/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/70af8d78a61a4155a37c330b19123a8d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:57.879585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e8188-6de1-4044-82ad-0d9ff55c46aa None admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e0d446112470b9a842113084ce3b0, user_id=70af8d78a61a4155a37c330b19123a8d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:10:57.881593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e8188-6de1-4044-82ad-0d9ff55c46aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:10:57.893404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 633/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Aug 17 14:10:57 2022] PUT /identity/v3/projects/fe1e0d446112470b9a842113084ce3b0/users/70af8d78a61a4155a37c330b19123a8d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:10:59.749777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906141-1551-48d2-8fcc-2063f1147509 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:59.750232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906141-1551-48d2-8fcc-2063f1147509 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:59.750332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906141-1551-48d2-8fcc-2063f1147509 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:59.751646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 641/1274] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:10:59.756699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:10:59.757091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:10:59.757243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:10:59.775230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:10:59.776434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:10:59.840673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 634/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:10:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:11:00.109607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906141-1551-48d2-8fcc-2063f1147509 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:00.221798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906141-1551-48d2-8fcc-2063f1147509 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:00.239731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:00.256889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:00.257512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:00.257785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:00.258052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:00.267618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 14:11:00.272289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:00.273371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:00.274429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 642/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Aug 17 14:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:00.279329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:00.357457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:00.377515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014b1b-066a-4d3e-b318-c68b0c4634ec None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:00.410521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:00.411116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:00.411392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:00.411659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:00.412378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:00.412678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:00.414040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:00.421652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 635/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Aug 17 14:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:00.427521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:00.524446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2439ee-31c7-4405-baa7-23b0dca68819 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:00.557089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:00.557693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:00.557968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:00.558238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:00.567977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:00.569988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:11:00.583623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:00.585387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:11:00.586459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:11:00.586459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:11:00.586459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:00.586459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 643/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:00.590990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:00.686614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bf715-ff81-4194-b8cd-ce7616d29728 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:00.719792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:00.720421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:00.720705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:00.720977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:00.721648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:00.721953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:00.723361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:00.734846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 636/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:00.740457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:00.775200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:00.842650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4804f-162c-43ca-b6b3-e6077ea1e5c0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:00.874113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:00.874731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:00.875010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:00.875277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:00.882807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:00.884256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 14:11:00.894765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:00.895844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:00.897782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 644/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:11:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:00.902279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:00.906087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:01.000023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07fd9-84a7-4f7b-bd7f-699d11c1eef9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:01.032724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:01.033319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:01.033598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:01.033869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:01.034590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:01.034893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:01.036349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:01.052520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 637/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Aug 17 14:11:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:01.058593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:01.147564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:01.157119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130712-e18f-4c38-b199-a4b45d0a836d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:01.189556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:01.190150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:01.190425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:01.190693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:01.254184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:01.255561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:01.339598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:01.350154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 645/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Aug 17 14:11:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 14:11:01.355939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:01.415079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:01.453398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3511f-0bec-43e3-ad32-774db5af95f2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:01.485774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:01.486394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:01.486671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:01.486940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:01.496492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:01.497917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 14:11:01.512357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:01.513406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 14:11:01.514359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 14:11:01.514359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 14:11:01.514359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:11:01.514359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 638/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:01.519832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:01.613828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa0f9e-6ae7-4dc0-97f5-bef2d1fabc39 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:01.646141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:01.647320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:01.647597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:01.647867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:01.648532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:01.648833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:01.650187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:01.660851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 646/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 17 14:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:01.666211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:01.764510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e09ed-93d3-49ea-8307-aeceb8d962f4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:01.778290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:01.798314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:01.798931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:01.799207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:01.799475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:01.805830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:01.807251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 14:11:01.818365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:01.819334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 17 14:11:01.820331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 639/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Aug 17 14:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:01.825364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:01.875610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:01.922620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2141d4f-9d29-404e-8cd9-cc2c7d093686 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:01.954961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:01.955549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:01.955828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:01.956124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:01.956805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:01.957106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:01.958516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8670e3c-b428-4163-8142-952a0c0488b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:01.969814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 647/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 17 14:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:01.975812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:02.072040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f638-5b47-4ec0-a8c9-7beb085299a5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:02.104274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:02.104858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:02.105136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:02.105404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:02.106121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] RBAC: Adding query filter params (role.id=4cd8ac9aa64446caaf8edf7398ec37ae, scope.project.id=fe1e0d446112470b9a842113084ce3b0, user.id=70af8d78a61a4155a37c330b19123a8d) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:02.106433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:02.107846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80652743-a1d7-4346-aa82-68d41f4231b1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:02.113406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 640/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Aug 17 14:11:01 2022] GET /identity/v3/role_assignments?user.id=70af8d78a61a4155a37c330b19123a8d&scope.project.id=fe1e0d446112470b9a842113084ce3b0&role.id=4cd8ac9aa64446caaf8edf7398ec37ae => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:03.979820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff3fa-6900-4c79-aac7-e553c1435962 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:03.980359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff3fa-6900-4c79-aac7-e553c1435962 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:03.980472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff3fa-6900-4c79-aac7-e553c1435962 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:03.981724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 648/1288] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:11:03.986683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:03.987049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:03.987234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:04.004767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:11:04.005904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:11:04.034813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:04.071678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 641/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:11:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:11:04.349039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff3fa-6900-4c79-aac7-e553c1435962 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:04.460086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff3fa-6900-4c79-aac7-e553c1435962 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:04.470819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:04.493996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:04.494620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:04.494899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:04.495171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:04.495753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:04.497151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:04.506255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:04.507456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:04.508718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 649/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:11:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:04.513425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:04.611397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40777a8-018e-4c54-988e-c46aed79af6b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:04.645398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:04.646005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:04.646832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:04.647109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:04.647740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:04.648073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:04.649448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53bf83-ddf5-40d2-8de9-a6ed7d84f17c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:04.654152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 642/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Aug 17 14:11:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:04.659929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:04.760218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711bcb3-1842-4596-8efe-4ebac8b3cf50 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:04.792748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:04.793355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:04.793636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:04.793910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:04.794532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:04.794835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:04.796234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7eb2-c618-4440-849e-bac1df691370 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:04.800550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 650/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Aug 17 14:11:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:06.661797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1466bb-ad2f-4023-b7bc-45a5094a0874 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:06.662346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1466bb-ad2f-4023-b7bc-45a5094a0874 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:06.662346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1466bb-ad2f-4023-b7bc-45a5094a0874 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:06.663687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 643/1293] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:11:06.668987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582774-8900-477d-8b96-c9e11d21a487 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:06.669374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582774-8900-477d-8b96-c9e11d21a487 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:06.669544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582774-8900-477d-8b96-c9e11d21a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:06.687111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bf582774-8900-477d-8b96-c9e11d21a487 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:11:06.688340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bf582774-8900-477d-8b96-c9e11d21a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:11:06.717739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:06.754429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 651/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:11:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:11:07.028164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1466bb-ad2f-4023-b7bc-45a5094a0874 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:07.058936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:07.126628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1466bb-ad2f-4023-b7bc-45a5094a0874 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:07.168811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85b73-b64c-4719-929a-88d8d6306892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:07.169619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85b73-b64c-4719-929a-88d8d6306892 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:07.170057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85b73-b64c-4719-929a-88d8d6306892 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:07.170475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85b73-b64c-4719-929a-88d8d6306892 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:07.171347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85b73-b64c-4719-929a-88d8d6306892 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:07.173480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85b73-b64c-4719-929a-88d8d6306892 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:07.192679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 644/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Aug 17 14:11:07 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:11:09.066035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6153c93-0324-4631-900c-48cb936858ba None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:09.066547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6153c93-0324-4631-900c-48cb936858ba None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:09.066547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6153c93-0324-4631-900c-48cb936858ba None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:09.067842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 652/1296] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:11:09.073009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:09.073424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:09.073566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:09.091402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:11:09.092625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:11:09.166347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 645/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:11:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:11:09.426197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6153c93-0324-4631-900c-48cb936858ba None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:09.523842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6153c93-0324-4631-900c-48cb936858ba None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:09.555916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:09.556555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:09.556835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:09.557107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:09.557681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:09.559037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:09.567742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:09.569389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:09.570242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 653/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:11:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 14:11:09.575194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:09.593257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:09.671059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362b564-29fd-4789-9441-64f15270d9f8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:09.703597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:09.704216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:09.704494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:09.704762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:09.705381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:09.705677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:09.707036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:09.711918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 646/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Aug 17 14:11:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:09.717712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:09.749411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:09.815773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7025-2b23-4157-adb0-c8f2108be50a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:09.847219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:09.847811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:09.848123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:09.848397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:09.849617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] RBAC: Adding query filter params (interface=public, service_id=e85ca399799245598ca0da8f5fd58e11, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:09.849926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:09.851303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5cd12-fa2f-4af9-b147-1f31c48b7aa7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:09.856111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 654/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Aug 17 14:11:09 2022] GET /identity/v3/endpoints?service_id=e85ca399799245598ca0da8f5fd58e11&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:09.861705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:09.940941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:09.958924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e57a4-1791-4910-8ff2-e8d9e0fb3378 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:09.990952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2a915-9d3a-4473-ab1d-346bcda3cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:09.991542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a915-9d3a-4473-ab1d-346bcda3cd35 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:09.991820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a915-9d3a-4473-ab1d-346bcda3cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:09.992121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a915-9d3a-4473-ab1d-346bcda3cd35 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:09.992720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2a915-9d3a-4473-ab1d-346bcda3cd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:09.994080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2a915-9d3a-4473-ab1d-346bcda3cd35 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:10.000629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 647/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Aug 17 14:11:09 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:11:11.859013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c78a8-c9a7-4404-87d1-8b71111eff05 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:11.859526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c78a8-c9a7-4404-87d1-8b71111eff05 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:11.859621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c78a8-c9a7-4404-87d1-8b71111eff05 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:11.860931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 655/1302] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:11:11.866714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:11.867101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:11.867270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:11.884970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:11:11.886166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:11:11.950549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 648/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:11:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 14:11:12.228409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c78a8-c9a7-4404-87d1-8b71111eff05 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:12.324823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:12.331575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c78a8-c9a7-4404-87d1-8b71111eff05 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:12.364591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:12.365207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:12.365488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:12.365756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:12.366325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:12.367674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 14:11:12.376000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 14:11:12.377128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 17 14:11:12.378170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 656/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Aug 17 14:11:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 14:11:12.383065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:12.455697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:12.479298 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6ed2-8a6e-4e1c-a2da-c94da4c8fa7f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:12.511101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:12.511692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:12.511988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:12.512265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:12.512884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:11:12.513184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:12.514539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b551dc5-f554-43f0-af15-490d6e94cc1a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:12.519429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 649/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Aug 17 14:11:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:11:12.525605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:11:12.620651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f87b9-082e-476f-b9f0-2220fd9cd3f8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:11:12.652938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb5139-f31a-4f24-bf6c-88aaa97d2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:11:12.653522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb5139-f31a-4f24-bf6c-88aaa97d2ccc None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:11:12.653800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb5139-f31a-4f24-bf6c-88aaa97d2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:11:12.654070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb5139-f31a-4f24-bf6c-88aaa97d2ccc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:11:12.654719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb5139-f31a-4f24-bf6c-88aaa97d2ccc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:11:12.656163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb5139-f31a-4f24-bf6c-88aaa97d2ccc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:11:12.674477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 657/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:11:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:11:22.516934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=30 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:11:22.670325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:15.622804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023ad3d-1eff-4394-8c21-0922b8d856ae None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:15.623212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023ad3d-1eff-4394-8c21-0922b8d856ae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:15.623212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023ad3d-1eff-4394-8c21-0922b8d856ae None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:15.624824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 650/1307] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:15.633644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c46d8-a89f-42a8-a3fd-0cba7f242f19 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:15.634604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c46d8-a89f-42a8-a3fd-0cba7f242f19 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:15.635158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c46d8-a89f-42a8-a3fd-0cba7f242f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:15.795267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-be8c46d8-a89f-42a8-a3fd-0cba7f242f19 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:15.796513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-be8c46d8-a89f-42a8-a3fd-0cba7f242f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:15.959617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 658/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:12:16.256253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c595ffb-f41c-4092-9331-fb5c7acfe69d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:16.256563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c595ffb-f41c-4092-9331-fb5c7acfe69d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:16.256975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c595ffb-f41c-4092-9331-fb5c7acfe69d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:16.258604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 651/1309] 10.222.0.23 () {54 vars in 965 bytes} [Wed Aug 17 14:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:16.265216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14e4c5-a09d-4159-bcad-f67d2931d627 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:16.265540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14e4c5-a09d-4159-bcad-f67d2931d627 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:16.265777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14e4c5-a09d-4159-bcad-f67d2931d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:16.345143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aa14e4c5-a09d-4159-bcad-f67d2931d627 None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:16.346425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa14e4c5-a09d-4159-bcad-f67d2931d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:16.367292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:16.425654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 659/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Aug 17 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:16.434441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c595ffb-f41c-4092-9331-fb5c7acfe69d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:16.436257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c595ffb-f41c-4092-9331-fb5c7acfe69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:16.547145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c595ffb-f41c-4092-9331-fb5c7acfe69d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:16.624416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:16.625056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:16.625304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:16.625551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:16.627193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:16.682809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:16.745232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:16.746680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d32b-23cc-4b2d-9985-22d3331cad0e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:16.765788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 652/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:18.947571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea0e60-32d9-46b5-b281-890323d6d1f1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:18.948396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea0e60-32d9-46b5-b281-890323d6d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:18.948396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea0e60-32d9-46b5-b281-890323d6d1f1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:18.949565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 660/1312] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:18.955310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d11f8-8313-4c89-9636-23ee83fe4b4b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:18.955826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d11f8-8313-4c89-9636-23ee83fe4b4b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:18.956069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d11f8-8313-4c89-9636-23ee83fe4b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:19.028996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7c4d11f8-8313-4c89-9636-23ee83fe4b4b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:19.030214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7c4d11f8-8313-4c89-9636-23ee83fe4b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:19.124339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 653/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:19.405444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea0e60-32d9-46b5-b281-890323d6d1f1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:19.407508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7eea0e60-32d9-46b5-b281-890323d6d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:19.509936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea0e60-32d9-46b5-b281-890323d6d1f1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:19.590120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:19.592580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:19.593572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:19.594081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:19.595041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:19.597010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:19.705231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:19.706682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63782af-2a33-4a39-ac14-1b45429ea58d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:19.725301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 661/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:12:21.940019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6f5c-1f6c-44fb-a742-cdfbbadeff23 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:21.940562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6f5c-1f6c-44fb-a742-cdfbbadeff23 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:21.940562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6f5c-1f6c-44fb-a742-cdfbbadeff23 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:21.941926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 654/1315] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:21.947178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902aa1c-c4bf-46a2-8aea-cdade75e5eec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:21.947604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902aa1c-c4bf-46a2-8aea-cdade75e5eec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:21.947732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902aa1c-c4bf-46a2-8aea-cdade75e5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:22.011424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3902aa1c-c4bf-46a2-8aea-cdade75e5eec None None] MFA Rules not processed for user `dd10d0d387e344a28f352cb08913b6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:22.012592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3902aa1c-c4bf-46a2-8aea-cdade75e5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:22.064210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:22.108304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 662/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:22.398389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a6f5c-1f6c-44fb-a742-cdfbbadeff23 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:22.399995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-572a6f5c-1f6c-44fb-a742-cdfbbadeff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:22.410537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:22.504495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a6f5c-1f6c-44fb-a742-cdfbbadeff23 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:22.581732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:22.582334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:22.582612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:22.582910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:22.584549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:22.645067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:22.691551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:22.693018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b64f6-cbab-4b26-a819-7e957d31a8b8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:22.711488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 655/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:25.171163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad34a-f448-457e-bd86-e966abe63d13 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:25.171676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad34a-f448-457e-bd86-e966abe63d13 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:25.171676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad34a-f448-457e-bd86-e966abe63d13 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:25.173029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 663/1318] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:25.178278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa0382-968e-4644-b100-2355262d33df None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:25.178677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa0382-968e-4644-b100-2355262d33df None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:25.178837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa0382-968e-4644-b100-2355262d33df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:25.243359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-81aa0382-968e-4644-b100-2355262d33df None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:25.244701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-81aa0382-968e-4644-b100-2355262d33df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:25.340186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 656/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:25.623687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad34a-f448-457e-bd86-e966abe63d13 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:25.625790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-76bad34a-f448-457e-bd86-e966abe63d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:25.725955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad34a-f448-457e-bd86-e966abe63d13 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:25.801655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:25.802260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:25.802540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:25.802809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:25.804502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:25.811895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:25.910125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:25.911487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfcdc2-3db9-4767-a66c-f14125400479 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:25.929377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 664/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:28.472263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5770-25c9-46ea-b2b6-43649aa986bd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:28.472912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5770-25c9-46ea-b2b6-43649aa986bd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:28.472912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5770-25c9-46ea-b2b6-43649aa986bd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:28.474163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 657/1321] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:28.479255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20b5f-f266-4287-be32-77c4363d799d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:28.479705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20b5f-f266-4287-be32-77c4363d799d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:28.479807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20b5f-f266-4287-be32-77c4363d799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:28.544328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1ba20b5f-f266-4287-be32-77c4363d799d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:28.545532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1ba20b5f-f266-4287-be32-77c4363d799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:28.603835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:28.644548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 665/1322] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:28.926770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5770-25c9-46ea-b2b6-43649aa986bd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:28.928435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-375e5770-25c9-46ea-b2b6-43649aa986bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:28.948953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:29.032547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5770-25c9-46ea-b2b6-43649aa986bd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:29.106946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:29.107501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:29.107790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:29.108119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:29.110296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:29.181239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:29.219879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:29.221358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e770513-cadb-4140-bd06-b2be98a17882 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:29.239533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 658/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:31.180371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444560c-81c2-48ea-af2c-5febf1cedb80 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:31.180882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444560c-81c2-48ea-af2c-5febf1cedb80 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:31.180882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444560c-81c2-48ea-af2c-5febf1cedb80 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:31.182158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 666/1324] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:31.187527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a43046-36c7-4fcd-8985-7e086d7915d1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:31.187994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a43046-36c7-4fcd-8985-7e086d7915d1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:31.188099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a43046-36c7-4fcd-8985-7e086d7915d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:31.252549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-41a43046-36c7-4fcd-8985-7e086d7915d1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:31.253749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41a43046-36c7-4fcd-8985-7e086d7915d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:31.349850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 659/1325] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:31.629426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444560c-81c2-48ea-af2c-5febf1cedb80 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:31.631028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8444560c-81c2-48ea-af2c-5febf1cedb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:31.737547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444560c-81c2-48ea-af2c-5febf1cedb80 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:31.815050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:31.815664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:31.815944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:31.816244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:31.817837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:31.834766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:31.928163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:31.929605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a671-c697-4514-84ac-e0acfa4627e2 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:31.947347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 667/1326] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:33.889135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021594a-82e0-4c77-a9fa-b836c0eb462b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:33.889586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021594a-82e0-4c77-a9fa-b836c0eb462b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:33.889691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021594a-82e0-4c77-a9fa-b836c0eb462b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:33.891697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 660/1327] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:33.897000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fe567-1661-4c00-a71b-6f3e26c44941 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:33.897452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fe567-1661-4c00-a71b-6f3e26c44941 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:33.897550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fe567-1661-4c00-a71b-6f3e26c44941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:33.978363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c43fe567-1661-4c00-a71b-6f3e26c44941 None None] MFA Rules not processed for user `dd10d0d387e344a28f352cb08913b6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:33.979586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c43fe567-1661-4c00-a71b-6f3e26c44941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:34.050565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:34.083282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 668/1328] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:12:34.365151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021594a-82e0-4c77-a9fa-b836c0eb462b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:34.366693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0021594a-82e0-4c77-a9fa-b836c0eb462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:34.401806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:34.479548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021594a-82e0-4c77-a9fa-b836c0eb462b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:34.551925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:34.552583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:34.552845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:34.553123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:34.554732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:34.632213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:34.663254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:34.664774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c9b3c-51fd-4191-8f1a-c487ca5a172f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:34.682644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 661/1329] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:36.834414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6be72-4d31-4f93-afa7-6941670265f4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:36.834941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6be72-4d31-4f93-afa7-6941670265f4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:36.834941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6be72-4d31-4f93-afa7-6941670265f4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:36.836346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 669/1330] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:36.841365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f637-58e9-4706-9648-a2ea5cbdde0c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:36.841782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f637-58e9-4706-9648-a2ea5cbdde0c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:36.841921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f637-58e9-4706-9648-a2ea5cbdde0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:36.906217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a7b9f637-58e9-4706-9648-a2ea5cbdde0c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:36.907425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a7b9f637-58e9-4706-9648-a2ea5cbdde0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:37.006391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 662/1331] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:37.286279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6be72-4d31-4f93-afa7-6941670265f4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:37.287804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-afd6be72-4d31-4f93-afa7-6941670265f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:37.389504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6be72-4d31-4f93-afa7-6941670265f4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:37.468649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:37.469245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:37.469521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:37.469786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:37.471354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:37.497017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:37.577336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:37.579250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e8c57-c4b6-4ce6-86a3-6bf182d85cff service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:37.596538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 670/1332] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:39.517450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688790e5-93cc-491e-946d-6105e77787f1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:39.518011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688790e5-93cc-491e-946d-6105e77787f1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:39.518011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688790e5-93cc-491e-946d-6105e77787f1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:39.519351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 663/1333] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:39.524500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a288b-41ac-4d39-a7d0-e250d3b549f3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:39.524899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a288b-41ac-4d39-a7d0-e250d3b549f3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:39.525062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a288b-41ac-4d39-a7d0-e250d3b549f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:39.593716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6c6a288b-41ac-4d39-a7d0-e250d3b549f3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:39.594926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6c6a288b-41ac-4d39-a7d0-e250d3b549f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:39.667648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:39.690668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 671/1334] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:40.000080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee4cbf-ea73-44de-ace2-addd70b0518e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:40.000370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee4cbf-ea73-44de-ace2-addd70b0518e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:40.000672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee4cbf-ea73-44de-ace2-addd70b0518e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:40.002044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 664/1335] 10.222.0.23 () {54 vars in 965 bytes} [Wed Aug 17 14:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:40.008001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc0d12-4573-4c57-859f-e6fed15bbd3a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:40.008294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc0d12-4573-4c57-859f-e6fed15bbd3a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:40.008571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc0d12-4573-4c57-859f-e6fed15bbd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:40.082245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2efc0d12-4573-4c57-859f-e6fed15bbd3a None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:40.083450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2efc0d12-4573-4c57-859f-e6fed15bbd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:40.157621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 672/1336] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Aug 17 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:40.166796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee4cbf-ea73-44de-ace2-addd70b0518e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:40.168392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2eee4cbf-ea73-44de-ace2-addd70b0518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:40.208626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:40.271563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee4cbf-ea73-44de-ace2-addd70b0518e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:40.345353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:40.345956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:40.346237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:40.346504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:40.348133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:40.427940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:40.455704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:40.457186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edf0a6-b59e-460e-80d5-2cc811312923 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:40.476213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 665/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:43.210150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e758e-840a-416f-a7c3-24ec7b2581dc None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:43.210680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e758e-840a-416f-a7c3-24ec7b2581dc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:43.210680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e758e-840a-416f-a7c3-24ec7b2581dc None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:43.212133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 673/1338] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:43.217203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa4b0-a2af-46a0-b65c-861d64bb5440 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:43.217616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa4b0-a2af-46a0-b65c-861d64bb5440 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:43.217761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa4b0-a2af-46a0-b65c-861d64bb5440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:43.282802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-176aa4b0-a2af-46a0-b65c-861d64bb5440 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:43.284019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-176aa4b0-a2af-46a0-b65c-861d64bb5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:43.377477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 666/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:43.656099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e758e-840a-416f-a7c3-24ec7b2581dc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:43.657641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad9e758e-840a-416f-a7c3-24ec7b2581dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:43.739755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:43.769521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e758e-840a-416f-a7c3-24ec7b2581dc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:43.841509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:43.842111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:43.842390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:43.842685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:43.844305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:43.950896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:43.952431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651204e8-18f7-41eb-8932-94ee2211d7bf service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:43.971253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 674/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:47.919123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238036-1783-4840-b6a9-f4c7236a9cc1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:47.919668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238036-1783-4840-b6a9-f4c7236a9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:47.919668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238036-1783-4840-b6a9-f4c7236a9cc1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:47.921101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 667/1341] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:47.926378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92850ba3-c58b-47dc-8a6d-51233860ed20 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:47.926785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92850ba3-c58b-47dc-8a6d-51233860ed20 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:47.926988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92850ba3-c58b-47dc-8a6d-51233860ed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:47.932502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:47.994012 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-92850ba3-c58b-47dc-8a6d-51233860ed20 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:47.995143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-92850ba3-c58b-47dc-8a6d-51233860ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:48.091729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 675/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:48.378248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238036-1783-4840-b6a9-f4c7236a9cc1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:48.379892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e4238036-1783-4840-b6a9-f4c7236a9cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:48.428433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:48.484376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238036-1783-4840-b6a9-f4c7236a9cc1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:48.555403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:48.556041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:48.556317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:48.556584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:48.558181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:48.651387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:48.667416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:48.668884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7a92a-4d2b-42dc-b75e-37647a479dbb service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:48.687697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 668/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:51.179643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e795d-096a-41fa-97b3-63269b34999b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:51.180186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e795d-096a-41fa-97b3-63269b34999b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:51.180186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e795d-096a-41fa-97b3-63269b34999b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:51.181643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 676/1344] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:51.187349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561bce8-344c-4bcd-bdf0-858a6435d764 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:51.187752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561bce8-344c-4bcd-bdf0-858a6435d764 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:51.187901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561bce8-344c-4bcd-bdf0-858a6435d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:51.261313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7561bce8-344c-4bcd-bdf0-858a6435d764 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:51.262526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7561bce8-344c-4bcd-bdf0-858a6435d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:51.359352 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 669/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:51.640834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e795d-096a-41fa-97b3-63269b34999b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:51.642394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-570e795d-096a-41fa-97b3-63269b34999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:51.727508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:51.748207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e795d-096a-41fa-97b3-63269b34999b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:51.830445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:51.831063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:51.831344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:51.831617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:51.833265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:51.946076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:51.947432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96631a46-fdd7-4907-b3db-1e67e2d86df9 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:51.965582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 677/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:12:55.796700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46960f-a817-4135-b952-a0f545d35827 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:55.797132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46960f-a817-4135-b952-a0f545d35827 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:55.797132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46960f-a817-4135-b952-a0f545d35827 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:55.798494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 670/1347] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:12:55.803840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00727bcc-1420-4c68-830d-ea1a35eb281d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:55.804314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00727bcc-1420-4c68-830d-ea1a35eb281d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:55.804423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00727bcc-1420-4c68-830d-ea1a35eb281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:55.831485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:55.893143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-00727bcc-1420-4c68-830d-ea1a35eb281d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:12:55.894556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-00727bcc-1420-4c68-830d-ea1a35eb281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:56.000415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 678/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:12:56.285691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46960f-a817-4135-b952-a0f545d35827 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:12:56.287248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9d46960f-a817-4135-b952-a0f545d35827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:56.348683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:56.396906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46960f-a817-4135-b952-a0f545d35827 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:12:56.474299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:12:56.474929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:12:56.475211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:12:56.475482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:12:56.477121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:12:56.581952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:12:56.586046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:12:56.587491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d80ed-c41e-47d7-8756-5a40763c3fd0 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:12:56.606146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 671/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:01.408030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684200-3fc0-4a41-9a3c-4e5f186feec3 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:01.408509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684200-3fc0-4a41-9a3c-4e5f186feec3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:01.408612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684200-3fc0-4a41-9a3c-4e5f186feec3 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:01.410768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 679/1350] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:01.415227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6aa98-b6e3-4822-919c-fa96797108b1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:01.415714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6aa98-b6e3-4822-919c-fa96797108b1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:01.415804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6aa98-b6e3-4822-919c-fa96797108b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:01.511617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-97d6aa98-b6e3-4822-919c-fa96797108b1 None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:01.515195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-97d6aa98-b6e3-4822-919c-fa96797108b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:01.646216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 672/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:05.909136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81266a-3042-438f-9f58-8638f0254580 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:05.909971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81266a-3042-438f-9f58-8638f0254580 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:05.910413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81266a-3042-438f-9f58-8638f0254580 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:05.912181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 680/1352] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:05.917328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865360e-8430-4963-9fd2-2a9f71720d17 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:05.917733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865360e-8430-4963-9fd2-2a9f71720d17 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:05.918072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865360e-8430-4963-9fd2-2a9f71720d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:05.979969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:05.999496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=59 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:06.004525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d865360e-8430-4963-9fd2-2a9f71720d17 None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:06.005808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d865360e-8430-4963-9fd2-2a9f71720d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:06.128540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 673/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:07.455597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91adbdd-3b5e-4660-a3cf-d621f9eac5be None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:07.456165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91adbdd-3b5e-4660-a3cf-d621f9eac5be None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:07.456256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91adbdd-3b5e-4660-a3cf-d621f9eac5be None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:07.457534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 681/1354] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:07.462464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988247-ade8-4618-95ca-b323f6dbb94f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:07.462861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988247-ade8-4618-95ca-b323f6dbb94f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:07.463011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988247-ade8-4618-95ca-b323f6dbb94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:07.540706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6d988247-ade8-4618-95ca-b323f6dbb94f None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:07.541921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d988247-ade8-4618-95ca-b323f6dbb94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:07.586907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:07.653401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 674/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:10.940655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b625-886d-48fc-b035-a5a67ac3afd6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:10.941217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b625-886d-48fc-b035-a5a67ac3afd6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:10.941217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b625-886d-48fc-b035-a5a67ac3afd6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:10.942546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 682/1356] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:10.948838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd49f-715c-4a1a-b0ee-3e3c6da928c4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:10.949249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd49f-715c-4a1a-b0ee-3e3c6da928c4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:10.949415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd49f-715c-4a1a-b0ee-3e3c6da928c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:11.034818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-30dfd49f-715c-4a1a-b0ee-3e3c6da928c4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:11.036059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30dfd49f-715c-4a1a-b0ee-3e3c6da928c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:11.164546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 675/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:11.474293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17246103-77d0-4413-beeb-9eb56e48c5d5 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:11.474932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17246103-77d0-4413-beeb-9eb56e48c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:11.475366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17246103-77d0-4413-beeb-9eb56e48c5d5 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:11.476951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 683/1358] 10.222.0.23 () {54 vars in 962 bytes} [Wed Aug 17 14:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:11.487531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9d6de-383e-4f98-adc7-8ed6ae31fa1e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:11.488155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9d6de-383e-4f98-adc7-8ed6ae31fa1e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:11.488539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9d6de-383e-4f98-adc7-8ed6ae31fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:11.506178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:11.568561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-15b9d6de-383e-4f98-adc7-8ed6ae31fa1e None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:11.569882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-15b9d6de-383e-4f98-adc7-8ed6ae31fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:11.697569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 676/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 17 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:11.708254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17246103-77d0-4413-beeb-9eb56e48c5d5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:11.709802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-17246103-77d0-4413-beeb-9eb56e48c5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:11.865720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17246103-77d0-4413-beeb-9eb56e48c5d5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:11.945679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:11.988454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:11.988974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:11.989252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:11.989521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:11.991098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:12.080155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:12.081748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71a068-6dff-400a-b065-9e02b122608a service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:12.100970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 684/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:14.233011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d861e-247e-4d3c-a267-3e37408c2c19 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:14.233403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d861e-247e-4d3c-a267-3e37408c2c19 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:14.233583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d861e-247e-4d3c-a267-3e37408c2c19 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:14.234945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 677/1361] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:14.241020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049de99-eb79-4c87-b1f4-d40e69fcad75 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:14.241502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049de99-eb79-4c87-b1f4-d40e69fcad75 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:14.242522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049de99-eb79-4c87-b1f4-d40e69fcad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:14.317724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0049de99-eb79-4c87-b1f4-d40e69fcad75 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:14.318914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0049de99-eb79-4c87-b1f4-d40e69fcad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:14.358836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:14.424007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 685/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:14.719845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d861e-247e-4d3c-a267-3e37408c2c19 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:14.721034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-832d861e-247e-4d3c-a267-3e37408c2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:14.816698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:14.904941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d861e-247e-4d3c-a267-3e37408c2c19 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:15.028968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:15.029896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:15.030481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:15.030910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:15.032922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:15.060448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:15.142405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:15.144226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70ab77-079c-4226-9710-6b23e917b182 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:15.165320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 678/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:17.393884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f1e-2acb-4b71-b508-96a52134b4be None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:17.394757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f1e-2acb-4b71-b508-96a52134b4be None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:17.395272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f1e-2acb-4b71-b508-96a52134b4be None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:17.396871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 686/1364] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:17.403748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc331c-4a90-47ff-858e-0859d7165ffe None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:17.404272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc331c-4a90-47ff-858e-0859d7165ffe None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:17.404368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc331c-4a90-47ff-858e-0859d7165ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:17.479377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-65fc331c-4a90-47ff-858e-0859d7165ffe None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:17.480635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-65fc331c-4a90-47ff-858e-0859d7165ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:17.580706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:17.583182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 679/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:17.873816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560c3a-e4d6-496f-ab63-252412189b25 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:17.874098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560c3a-e4d6-496f-ab63-252412189b25 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:17.875210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560c3a-e4d6-496f-ab63-252412189b25 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:17.876935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 687/1366] 10.222.0.23 () {54 vars in 962 bytes} [Wed Aug 17 14:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:17.884821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe970-4876-49be-b126-6987c3882ec9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:17.885274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe970-4876-49be-b126-6987c3882ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:17.886330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe970-4876-49be-b126-6987c3882ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:17.968202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6befe970-4876-49be-b126-6987c3882ec9 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:17.969432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6befe970-4876-49be-b126-6987c3882ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:18.092703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 680/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 17 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:18.101490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560c3a-e4d6-496f-ab63-252412189b25 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:18.103310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88560c3a-e4d6-496f-ab63-252412189b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:18.259016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560c3a-e4d6-496f-ab63-252412189b25 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:18.282324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:18.383799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:18.384459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:18.384741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:18.385015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:18.386655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:18.480671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:18.482842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e6726-e861-4320-a273-d72968d6383d service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:18.502561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 688/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:19.206773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958ff8-d0d5-42f3-a0c0-34beb4d3f419 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:19.207290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958ff8-d0d5-42f3-a0c0-34beb4d3f419 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:19.207290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958ff8-d0d5-42f3-a0c0-34beb4d3f419 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:19.208776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 681/1369] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:19.213823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0812df-bd79-4c75-8765-79ec7f4f38ec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:19.214117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0812df-bd79-4c75-8765-79ec7f4f38ec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:19.214396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0812df-bd79-4c75-8765-79ec7f4f38ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:19.247319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:19.285189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa0812df-bd79-4c75-8765-79ec7f4f38ec None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:19.286388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa0812df-bd79-4c75-8765-79ec7f4f38ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:19.393699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 689/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:19.975091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c4bc-1d96-4bb9-9efb-dc6275fd04f9 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:19.975091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c4bc-1d96-4bb9-9efb-dc6275fd04f9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:19.975091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10c4bc-1d96-4bb9-9efb-dc6275fd04f9 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:19.977672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 682/1371] 10.222.0.23 () {54 vars in 964 bytes} [Wed Aug 17 14:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:19.981815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e7f37-2438-4f45-b818-82bc084f62ca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:19.984291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e7f37-2438-4f45-b818-82bc084f62ca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:19.984291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e7f37-2438-4f45-b818-82bc084f62ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:20.062213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4c3e7f37-2438-4f45-b818-82bc084f62ca None None] MFA Rules not processed for user `4bd62078f127457392fa0dd755ed1a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:20.063463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4c3e7f37-2438-4f45-b818-82bc084f62ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:20.113192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:20.146274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 690/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Wed Aug 17 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:20.153038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10c4bc-1d96-4bb9-9efb-dc6275fd04f9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:20.154576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f10c4bc-1d96-4bb9-9efb-dc6275fd04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:20.209839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:20.267608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10c4bc-1d96-4bb9-9efb-dc6275fd04f9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:20.360877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:20.362226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:20.362384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:20.362720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:20.364538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:20.492068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:20.493863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48545486-f2a5-493f-b99f-40ef08dbab66 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:20.494162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48545486-f2a5-493f-b99f-40ef08dbab66 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:20.494367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48545486-f2a5-493f-b99f-40ef08dbab66 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:20.496302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 691/1373] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:20.501983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494874-e718-4c2e-943b-ac000675f7e8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:20.502535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494874-e718-4c2e-943b-ac000675f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:20.502949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494874-e718-4c2e-943b-ac000675f7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:20.510912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:20.512937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:20.537703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 683/1374] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:20.601809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-73494874-e718-4c2e-943b-ac000675f7e8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:20.604837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-73494874-e718-4c2e-943b-ac000675f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:20.725285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 692/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:21.022621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:21.023884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:21.126686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851db5-24d2-49dd-baa6-17fb1196adee service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:21.233143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:21.245031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:21.245639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:21.245920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:21.246191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:21.247823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:21.335803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:21.337434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889c47f-4d04-4577-adc7-ba3ab1821fe1 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:21.355471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 684/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:23.274746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2b3d-e9e5-405a-a7be-c599653f452f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:23.275323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2b3d-e9e5-405a-a7be-c599653f452f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:23.275323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2b3d-e9e5-405a-a7be-c599653f452f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:23.276679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 693/1377] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:23.281791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33664-dc57-46f0-be79-cd9364d4f926 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:23.282216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33664-dc57-46f0-be79-cd9364d4f926 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:23.282338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33664-dc57-46f0-be79-cd9364d4f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:23.349635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-35a33664-dc57-46f0-be79-cd9364d4f926 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:23.350807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-35a33664-dc57-46f0-be79-cd9364d4f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:23.416636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:23.456160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 685/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:23.747695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2b3d-e9e5-405a-a7be-c599653f452f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:23.749288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-596d2b3d-e9e5-405a-a7be-c599653f452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:23.800385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:23.899973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2b3d-e9e5-405a-a7be-c599653f452f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:24.061329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:24.061946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:24.062222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:24.062492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:24.064933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:24.084004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:24.185521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:24.187136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67032d-8ade-498e-939d-8fc90171a706 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:24.206167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 694/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:26.167075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75805022-f559-48a3-9056-a43d0dca0473 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:26.167886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75805022-f559-48a3-9056-a43d0dca0473 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:26.167886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75805022-f559-48a3-9056-a43d0dca0473 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:26.169808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 686/1380] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:26.175067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d1e9-c921-4dab-9ef3-7af071c166dd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:26.175523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d1e9-c921-4dab-9ef3-7af071c166dd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:26.175610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d1e9-c921-4dab-9ef3-7af071c166dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:26.245760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8976d1e9-c921-4dab-9ef3-7af071c166dd None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:26.247485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8976d1e9-c921-4dab-9ef3-7af071c166dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:26.338307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:26.352122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 695/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:26.640799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75805022-f559-48a3-9056-a43d0dca0473 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:26.642326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75805022-f559-48a3-9056-a43d0dca0473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:26.799387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75805022-f559-48a3-9056-a43d0dca0473 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:26.849273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:26.931607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:26.932425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:26.932800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:26.933191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:26.935819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:27.032176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:27.033767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db4afd-4e78-47ae-baf4-8fc232604e8c service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:27.052496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 687/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:29.143584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b610-02be-4077-a400-b2ab5a2e36ef None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:29.144117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b610-02be-4077-a400-b2ab5a2e36ef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:29.144117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b610-02be-4077-a400-b2ab5a2e36ef None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:29.145423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 696/1383] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:29.151181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beef9f-8fb7-423e-90d1-a1a51598a033 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:29.151611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beef9f-8fb7-423e-90d1-a1a51598a033 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:29.151935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beef9f-8fb7-423e-90d1-a1a51598a033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:29.236433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d6beef9f-8fb7-423e-90d1-a1a51598a033 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:29.237700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d6beef9f-8fb7-423e-90d1-a1a51598a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:29.239847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:29.346895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 688/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:29.719399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b610-02be-4077-a400-b2ab5a2e36ef None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:29.720952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e5d0b610-02be-4077-a400-b2ab5a2e36ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:29.888943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b610-02be-4077-a400-b2ab5a2e36ef None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:29.953101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:30.004924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:30.005534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:30.005810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:30.006077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:30.007692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:30.101149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:30.103356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da936ce0-b25e-4c20-b68a-b0c9aa3edd03 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:30.126640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 697/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:32.048674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af84e7-8de7-40fd-adbb-681ffa88b445 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:32.049204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af84e7-8de7-40fd-adbb-681ffa88b445 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:32.049204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af84e7-8de7-40fd-adbb-681ffa88b445 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:32.050628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 689/1386] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:32.056333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65add1c4-3639-4ac6-b07e-6e707e7d25df None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:32.056803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65add1c4-3639-4ac6-b07e-6e707e7d25df None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:32.056905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65add1c4-3639-4ac6-b07e-6e707e7d25df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:32.123072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-65add1c4-3639-4ac6-b07e-6e707e7d25df None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:32.124318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-65add1c4-3639-4ac6-b07e-6e707e7d25df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:32.150089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:32.237216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 698/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:32.555457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af84e7-8de7-40fd-adbb-681ffa88b445 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:32.557068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d1af84e7-8de7-40fd-adbb-681ffa88b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:32.711494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:32.736029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af84e7-8de7-40fd-adbb-681ffa88b445 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:32.895645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:32.896449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:32.896821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:32.897196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:32.899799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:33.024665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:33.026390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627735df-23ee-4803-9247-3e8548cd4d21 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:33.033115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:33.049222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 690/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:35.229196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970008bf-e7ef-4a4f-a5cd-78f62c6e4dbf None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:35.229849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970008bf-e7ef-4a4f-a5cd-78f62c6e4dbf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:35.230464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970008bf-e7ef-4a4f-a5cd-78f62c6e4dbf None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:35.235995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 699/1389] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:35.237662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8bbb-0eb4-4ffe-a450-01d82ed899da None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:35.238106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8bbb-0eb4-4ffe-a450-01d82ed899da None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:35.238345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8bbb-0eb4-4ffe-a450-01d82ed899da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:35.310377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-465e8bbb-0eb4-4ffe-a450-01d82ed899da None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:35.311639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-465e8bbb-0eb4-4ffe-a450-01d82ed899da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:35.414144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 691/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:35.704861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970008bf-e7ef-4a4f-a5cd-78f62c6e4dbf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:35.706972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-970008bf-e7ef-4a4f-a5cd-78f62c6e4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:35.864402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970008bf-e7ef-4a4f-a5cd-78f62c6e4dbf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:35.875351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:35.982870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:35.983500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:35.983777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:35.984082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:35.985706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:36.081643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:36.083296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df4889-1daa-44d5-ade8-7022a035e2c5 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:36.102868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 700/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:38.141786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc458a6-d808-48b4-addd-76a06e6253b1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:38.142474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc458a6-d808-48b4-addd-76a06e6253b1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:38.142474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc458a6-d808-48b4-addd-76a06e6253b1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:38.143736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 692/1392] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:38.149196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df707-0e33-477d-987f-ad85e1437a2d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:38.149614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df707-0e33-477d-987f-ad85e1437a2d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:38.149793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df707-0e33-477d-987f-ad85e1437a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:38.167035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:38.222688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-198df707-0e33-477d-987f-ad85e1437a2d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:38.223940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-198df707-0e33-477d-987f-ad85e1437a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:38.323471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 701/1393] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:38.611322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc458a6-d808-48b4-addd-76a06e6253b1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:38.612912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4bc458a6-d808-48b4-addd-76a06e6253b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:38.687856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:38.764290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc458a6-d808-48b4-addd-76a06e6253b1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:38.880644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:38.881217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:38.881503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:38.881774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:38.883397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:38.917508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:38.976414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:38.978085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c849-aa14-414d-b48b-4aef837a2c26 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:38.997220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 693/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:40.936815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf326-0e6e-4114-ad74-3d0c92839845 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:40.937374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf326-0e6e-4114-ad74-3d0c92839845 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:40.937374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf326-0e6e-4114-ad74-3d0c92839845 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:40.938713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 702/1395] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:40.944187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:40.944638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:40.944736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.011223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:41.012403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:41.026395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5680b4-de62-4f96-b6f9-1a15c28555e1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:41.027210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5680b4-de62-4f96-b6f9-1a15c28555e1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:41.027460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5680b4-de62-4f96-b6f9-1a15c28555e1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.029011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 703/1396] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:13:41.033565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178fb5f-6ede-44f8-92b1-c8e184ad4ba1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:41.033856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178fb5f-6ede-44f8-92b1-c8e184ad4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:41.034141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178fb5f-6ede-44f8-92b1-c8e184ad4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.102193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6178fb5f-6ede-44f8-92b1-c8e184ad4ba1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:41.103423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6178fb5f-6ede-44f8-92b1-c8e184ad4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:41.111303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 694/1397] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:41.145388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:41.203798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 704/1398] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:13:41.402044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:41.403360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:41.413263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:41.503159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb04c-41fe-4f94-bba7-def4d5c98734 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:41.503524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb04c-41fe-4f94-bba7-def4d5c98734 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:41.503873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb04c-41fe-4f94-bba7-def4d5c98734 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.505452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 705/1399] 10.222.0.23 () {54 vars in 967 bytes} [Wed Aug 17 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:13:41.510092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:41.510384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:41.511190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.522439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e342662-4607-4bd2-b41f-c28bbdcae5b6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:41.587967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] MFA Rules not processed for user `3fb472deed9140dcbb47301a3871a21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:41.589777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:41.638422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:41.639148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:41.639429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:41.639747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.641314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:41.644475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:41.667675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 706/1400] 10.222.0.23 () {58 vars in 1064 bytes} [Wed Aug 17 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:41.674639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:41.684924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c788bf-d7cc-4537-89e7-6239e6345343 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:41.721668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:41.747326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:41.749063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8438f-eebd-4858-bc4a-16c7c1406f83 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:41.765916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:41.766525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:41.766803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:41.767074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:41.768063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 695/1401] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:41.768708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:41.886955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:41.888468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137c5e9-156b-4b2d-a5e2-679b9d723097 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:41.908490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 707/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:13:42.648911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d70e5-facf-415d-b4f7-07162e734071 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:42.649392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d70e5-facf-415d-b4f7-07162e734071 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:42.649496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d70e5-facf-415d-b4f7-07162e734071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:42.715975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-548d70e5-facf-415d-b4f7-07162e734071 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:42.717208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-548d70e5-facf-415d-b4f7-07162e734071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:42.803293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:42.811814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 696/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:42.858188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41956-40b7-4bb6-8230-4d53425c4f02 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:42.858633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41956-40b7-4bb6-8230-4d53425c4f02 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:42.858740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41956-40b7-4bb6-8230-4d53425c4f02 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:42.860141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 708/1404] 10.222.0.23 () {54 vars in 943 bytes} [Wed Aug 17 14:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:42.866526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d419a9-e8dc-4067-a3d7-ccb7be3bbb31 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:42.866877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d419a9-e8dc-4067-a3d7-ccb7be3bbb31 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:42.867218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d419a9-e8dc-4067-a3d7-ccb7be3bbb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:42.944324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-77d419a9-e8dc-4067-a3d7-ccb7be3bbb31 None None] MFA Rules not processed for user `c3280a3468db42b29ce76accc1458f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:42.945424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-77d419a9-e8dc-4067-a3d7-ccb7be3bbb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:43.054739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 697/1405] 10.222.0.23 () {58 vars in 1040 bytes} [Wed Aug 17 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:43.064952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41956-40b7-4bb6-8230-4d53425c4f02 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:43.066555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-11d41956-40b7-4bb6-8230-4d53425c4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:43.132216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:43.204000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41956-40b7-4bb6-8230-4d53425c4f02 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:43.305934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:43.306550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:43.306832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:43.307106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:43.309571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:43.361095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:43.395867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:43.397500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c757e-972f-4751-9efd-2ca6226168bd service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:43.406149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 709/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:13:43.707757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47538b-04dd-400d-a38f-6ffce2ecc806 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:43.708968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47538b-04dd-400d-a38f-6ffce2ecc806 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:43.709480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47538b-04dd-400d-a38f-6ffce2ecc806 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:43.710843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 698/1407] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:13:43.716876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe79e24-64cd-49f1-9440-3293dec8196d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:43.717358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe79e24-64cd-49f1-9440-3293dec8196d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:43.717706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe79e24-64cd-49f1-9440-3293dec8196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:43.789333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ffe79e24-64cd-49f1-9440-3293dec8196d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:13:43.790585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ffe79e24-64cd-49f1-9440-3293dec8196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:43.902122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 710/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:13:44.192395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47538b-04dd-400d-a38f-6ffce2ecc806 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:13:44.194042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1b47538b-04dd-400d-a38f-6ffce2ecc806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:44.259107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:44.362572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47538b-04dd-400d-a38f-6ffce2ecc806 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:13:44.501634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:13:44.502561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:13:44.502838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:13:44.503104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:13:44.504746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:13:44.518794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:44.613863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:13:44.615524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3613f3-bb53-4316-90f3-5f2d20cc64a1 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:13:44.643312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 699/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:13:53.899254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:54.640607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=39 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:05.181692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f47-e5fa-49e6-8c1d-806fa9e18fe7 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:05.182211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f47-e5fa-49e6-8c1d-806fa9e18fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:05.182211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f47-e5fa-49e6-8c1d-806fa9e18fe7 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:05.183834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 711/1410] 10.222.0.23 () {54 vars in 918 bytes} [Wed Aug 17 14:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:05.188998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bc651-580f-4add-bf62-663c71c78fd2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:05.189391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bc651-580f-4add-bf62-663c71c78fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:05.189553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bc651-580f-4add-bf62-663c71c78fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:05.264452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6e8bc651-580f-4add-bf62-663c71c78fd2 None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:05.265674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e8bc651-580f-4add-bf62-663c71c78fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:05.371124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 700/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Aug 17 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:05.385803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b80b2-3eb7-49ba-b5e8-58ac76d44428 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:05.386095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b80b2-3eb7-49ba-b5e8-58ac76d44428 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:05.386374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b80b2-3eb7-49ba-b5e8-58ac76d44428 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:05.387727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 712/1412] 10.222.0.23 () {54 vars in 918 bytes} [Wed Aug 17 14:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:05.392201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06239737-8411-44e9-95ef-1440675b32a3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:05.392491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06239737-8411-44e9-95ef-1440675b32a3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:05.392766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06239737-8411-44e9-95ef-1440675b32a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:05.464505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:05.467157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-06239737-8411-44e9-95ef-1440675b32a3 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:05.468993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-06239737-8411-44e9-95ef-1440675b32a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:05.700279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 701/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Aug 17 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:08.071883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3965-8b3e-4050-bdc5-d937cf84b22f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:08.072437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3965-8b3e-4050-bdc5-d937cf84b22f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:08.072437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3965-8b3e-4050-bdc5-d937cf84b22f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:08.073701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:08.078857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f7add-56fe-4ee9-bf76-6cc963605bd2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:08.079275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f7add-56fe-4ee9-bf76-6cc963605bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:08.079390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f7add-56fe-4ee9-bf76-6cc963605bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:08.144253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e48f7add-56fe-4ee9-bf76-6cc963605bd2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:08.145454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e48f7add-56fe-4ee9-bf76-6cc963605bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:08.200234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:08.241514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:08.526491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3965-8b3e-4050-bdc5-d937cf84b22f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:08.528068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-905a3965-8b3e-4050-bdc5-d937cf84b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:08.671914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3965-8b3e-4050-bdc5-d937cf84b22f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:08.744375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:08.785289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:08.785831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:08.786115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:08.786387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:08.788024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:08.880254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:08.881864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e37e-387a-4080-a212-97f20ee20392 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:08.900160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 714/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:09.773903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad735-6614-45f7-a3f7-64de3feb6864 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:09.774377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad735-6614-45f7-a3f7-64de3feb6864 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:09.774482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad735-6614-45f7-a3f7-64de3feb6864 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:09.775809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:09.780686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dedb7-2fc9-4e60-b863-9c7a03a0851b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:09.781090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dedb7-2fc9-4e60-b863-9c7a03a0851b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:09.781274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dedb7-2fc9-4e60-b863-9c7a03a0851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:09.855853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ee5dedb7-2fc9-4e60-b863-9c7a03a0851b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:09.857096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ee5dedb7-2fc9-4e60-b863-9c7a03a0851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:09.883632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:09.951413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:10.099307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ad735-6614-45f7-a3f7-64de3feb6864 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:10.100792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0b6ad735-6614-45f7-a3f7-64de3feb6864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:10.242724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ad735-6614-45f7-a3f7-64de3feb6864 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:10.282184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:10.354005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:10.354535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:10.354816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:10.355086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:10.356724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:10.443772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:10.445393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827fd1-0052-49e9-bbf6-afb9cfcb73ea service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:10.463778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 704/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:11.357743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440964e-96f7-4c31-8740-b503ea37c7fe None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:11.358326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440964e-96f7-4c31-8740-b503ea37c7fe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:11.358326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440964e-96f7-4c31-8740-b503ea37c7fe None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:11.359663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:11.364502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd7836-afc7-4aa7-aabe-1a8ae1c356f3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:11.364945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd7836-afc7-4aa7-aabe-1a8ae1c356f3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:11.365063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd7836-afc7-4aa7-aabe-1a8ae1c356f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:11.418921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:11.440839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8edd7836-afc7-4aa7-aabe-1a8ae1c356f3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:11.442061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8edd7836-afc7-4aa7-aabe-1a8ae1c356f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:11.535781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:11.687527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440964e-96f7-4c31-8740-b503ea37c7fe None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:11.689148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8440964e-96f7-4c31-8740-b503ea37c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:11.833332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440964e-96f7-4c31-8740-b503ea37c7fe None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:11.845130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:11.942965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:11.943500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:11.943777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:11.944078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:11.945666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:12.034870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:12.036503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec3a4-fbb1-400a-96e4-1e5b57bbef8a service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:12.053662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 717/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:12.916192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a91bb-7c53-4e0c-ae5a-9f552892dc99 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:12.916734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a91bb-7c53-4e0c-ae5a-9f552892dc99 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:12.916734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a91bb-7c53-4e0c-ae5a-9f552892dc99 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:12.918121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:12.923077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a7c2-c5e0-41ee-8723-a4d5b7c036b2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:12.923501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a7c2-c5e0-41ee-8723-a4d5b7c036b2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:12.923607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a7c2-c5e0-41ee-8723-a4d5b7c036b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:12.943498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:13.000996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cde7a7c2-c5e0-41ee-8723-a4d5b7c036b2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:13.002170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cde7a7c2-c5e0-41ee-8723-a4d5b7c036b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:13.099675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:13.249321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a91bb-7c53-4e0c-ae5a-9f552892dc99 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:13.250840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e92a91bb-7c53-4e0c-ae5a-9f552892dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:13.359093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:13.393952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a91bb-7c53-4e0c-ae5a-9f552892dc99 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:13.505205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:13.505800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:13.506076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:13.506346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:13.507934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:13.582184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:13.596567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:13.598158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db9272-5c6f-4636-833f-49ac32fcb421 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:13.616160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 707/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:14.481166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0dcb4-5df6-42d9-beab-1c7dd32b2e19 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:14.481704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0dcb4-5df6-42d9-beab-1c7dd32b2e19 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:14.481704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0dcb4-5df6-42d9-beab-1c7dd32b2e19 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:14.483072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:14.488203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a7c3-9742-44ca-b0a4-707437642aa6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:14.488632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a7c3-9742-44ca-b0a4-707437642aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:14.488747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a7c3-9742-44ca-b0a4-707437642aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:14.562075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-00d2a7c3-9742-44ca-b0a4-707437642aa6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:14.563274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-00d2a7c3-9742-44ca-b0a4-707437642aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:14.660193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:14.810153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0dcb4-5df6-42d9-beab-1c7dd32b2e19 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:14.811723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1ba0dcb4-5df6-42d9-beab-1c7dd32b2e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:14.893197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:14.953289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0dcb4-5df6-42d9-beab-1c7dd32b2e19 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:15.062518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:15.063051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:15.063327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:15.063596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:15.065200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:15.111323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:15.153587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:15.155182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246364cb-ce25-43b1-95ce-515e1bbbbf85 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:15.173941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 720/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:15.969396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2d3fd-c266-4ddf-8e75-f5dbf669c2cc None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:15.969914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2d3fd-c266-4ddf-8e75-f5dbf669c2cc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:15.970030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2d3fd-c266-4ddf-8e75-f5dbf669c2cc None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:15.971291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:15.976337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769a7d0-4955-4fb4-8a51-789c9da3be15 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:15.976797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769a7d0-4955-4fb4-8a51-789c9da3be15 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:15.976907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769a7d0-4955-4fb4-8a51-789c9da3be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:16.059108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9769a7d0-4955-4fb4-8a51-789c9da3be15 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:16.060274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9769a7d0-4955-4fb4-8a51-789c9da3be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:16.156440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:16.308402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2d3fd-c266-4ddf-8e75-f5dbf669c2cc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:16.310028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d2d2d3fd-c266-4ddf-8e75-f5dbf669c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:16.357356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:16.453891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2d3fd-c266-4ddf-8e75-f5dbf669c2cc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:16.564889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:16.565409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:16.565689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:16.565960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:16.567561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:16.575013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:16.658057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:16.659660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da33e3-1f72-4968-a0a8-086aa1e6049f service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:16.677898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 710/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:17.481905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66124c7-e723-4116-83e3-746776781d60 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:17.482565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66124c7-e723-4116-83e3-746776781d60 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:17.482565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66124c7-e723-4116-83e3-746776781d60 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:17.483842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:17.488951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed48bd-1f24-43e2-9c13-643dec63cd30 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:17.489378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed48bd-1f24-43e2-9c13-643dec63cd30 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:17.489506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed48bd-1f24-43e2-9c13-643dec63cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:17.564724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-68ed48bd-1f24-43e2-9c13-643dec63cd30 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:17.565848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-68ed48bd-1f24-43e2-9c13-643dec63cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:17.631609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:17.661201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:17.812760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66124c7-e723-4116-83e3-746776781d60 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:17.814295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c66124c7-e723-4116-83e3-746776781d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:17.831715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:17.957305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66124c7-e723-4116-83e3-746776781d60 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:18.042237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:18.067240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:18.067852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:18.068159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:18.068431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:18.070022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:18.157532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:18.159065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18732-99c8-4f3e-a551-d636a1e0df56 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:18.177290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 723/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:18.971762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f948826-191a-4658-99d7-0c24fd3425ee None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:18.972360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f948826-191a-4658-99d7-0c24fd3425ee None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:18.972478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f948826-191a-4658-99d7-0c24fd3425ee None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:18.973746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:18.978713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7550c-9476-4afd-9d46-81ef3af084c9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:18.979110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7550c-9476-4afd-9d46-81ef3af084c9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:18.979296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7550c-9476-4afd-9d46-81ef3af084c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:19.053215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0cc7550c-9476-4afd-9d46-81ef3af084c9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:19.054367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0cc7550c-9476-4afd-9d46-81ef3af084c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:19.096785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:19.150862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:19.301380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f948826-191a-4658-99d7-0c24fd3425ee None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:19.302939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9f948826-191a-4658-99d7-0c24fd3425ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:19.446233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f948826-191a-4658-99d7-0c24fd3425ee None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:19.500162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:19.557917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:19.558527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:19.558803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:19.559069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:19.560694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:19.646686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:19.648306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ee278-3eed-4b82-8df5-2fdf6e6a3379 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:19.666224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 713/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:20.463533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3b05-1a3a-4658-b713-2e30d0bb9465 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:20.464192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3b05-1a3a-4658-b713-2e30d0bb9465 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:20.464192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3b05-1a3a-4658-b713-2e30d0bb9465 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:20.465777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:20.470618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a0555-cd79-4330-a574-08d70486fb6b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:20.471025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a0555-cd79-4330-a574-08d70486fb6b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:20.471276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a0555-cd79-4330-a574-08d70486fb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:20.545796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e26a0555-cd79-4330-a574-08d70486fb6b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:20.547008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e26a0555-cd79-4330-a574-08d70486fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:20.549053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:20.642675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:14:20.792213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c3b05-1a3a-4658-b713-2e30d0bb9465 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:20.793708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ff5c3b05-1a3a-4658-b713-2e30d0bb9465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:20.937141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c3b05-1a3a-4658-b713-2e30d0bb9465 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:20.963683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:21.048392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:21.048932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:21.049208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:21.049473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:21.051039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:21.142761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:21.144398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596f301-9eeb-432d-9bc4-2bbf8e5c64bf service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:21.161700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 726/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:22.979015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d51f1c-71c5-4e0f-8117-94104fd6f08a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:22.979435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d51f1c-71c5-4e0f-8117-94104fd6f08a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:22.979572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d51f1c-71c5-4e0f-8117-94104fd6f08a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:22.980989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:22.986425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91e50-127c-4402-ae13-807c38931784 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:22.986821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91e50-127c-4402-ae13-807c38931784 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:22.987020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91e50-127c-4402-ae13-807c38931784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:23.030732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:23.055903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-88d91e50-127c-4402-ae13-807c38931784 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:23.057173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88d91e50-127c-4402-ae13-807c38931784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:23.152633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:23.432109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d51f1c-71c5-4e0f-8117-94104fd6f08a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:23.433908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-45d51f1c-71c5-4e0f-8117-94104fd6f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:23.536012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d51f1c-71c5-4e0f-8117-94104fd6f08a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:23.566768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:23.607455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:23.608087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:23.608371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:23.608643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:23.610244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:23.716194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:23.717636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccb479-3690-4780-a004-22b28ce255a8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:23.736067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 716/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:25.835274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba9b8c-e22a-4ec9-8a14-e6a54fc27e15 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:25.836381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba9b8c-e22a-4ec9-8a14-e6a54fc27e15 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:25.836507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba9b8c-e22a-4ec9-8a14-e6a54fc27e15 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:25.837768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:25.843066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7633b2-c057-4b56-8a49-5e5e8fb21c3f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:25.843486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7633b2-c057-4b56-8a49-5e5e8fb21c3f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:25.843610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7633b2-c057-4b56-8a49-5e5e8fb21c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:25.908190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6b7633b2-c057-4b56-8a49-5e5e8fb21c3f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:25.909394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6b7633b2-c057-4b56-8a49-5e5e8fb21c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:25.921732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:26.004958 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:26.287440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba9b8c-e22a-4ec9-8a14-e6a54fc27e15 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:26.289062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d3ba9b8c-e22a-4ec9-8a14-e6a54fc27e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:26.391780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba9b8c-e22a-4ec9-8a14-e6a54fc27e15 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:26.403727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:26.464475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:26.465080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:26.465363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:26.465639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:26.467227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:26.574438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:26.575806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a14b3f-4962-4095-a569-2beca1987ec4 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:26.593508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 729/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:28.787267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c7089-af5d-47f7-8776-13faf442af63 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:28.787787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c7089-af5d-47f7-8776-13faf442af63 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:28.787883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c7089-af5d-47f7-8776-13faf442af63 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:28.789229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:28.794331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef0f3-fb0d-4f77-ad99-c880cabc9f08 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:28.794708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef0f3-fb0d-4f77-ad99-c880cabc9f08 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:28.794882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef0f3-fb0d-4f77-ad99-c880cabc9f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:28.843577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:28.861030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0ceef0f3-fb0d-4f77-ad99-c880cabc9f08 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:28.862225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0ceef0f3-fb0d-4f77-ad99-c880cabc9f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:28.956824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:29.239447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c7089-af5d-47f7-8776-13faf442af63 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:29.241024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-586c7089-af5d-47f7-8776-13faf442af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:29.343299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c7089-af5d-47f7-8776-13faf442af63 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:29.382029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:29.416006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:29.416611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:29.416887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:29.417154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:29.418761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:29.526625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:29.528097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4c486-184e-408f-9e25-e2868225ba0a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:29.546609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 719/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:31.548529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44adb-9756-4e71-b746-1e18ef4112ed None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:31.549064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44adb-9756-4e71-b746-1e18ef4112ed None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:31.549064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44adb-9756-4e71-b746-1e18ef4112ed None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:31.550443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:31.556285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dc48-17c6-4c62-8e31-e0be19ce8266 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:31.556707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dc48-17c6-4c62-8e31-e0be19ce8266 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:31.556809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dc48-17c6-4c62-8e31-e0be19ce8266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:31.621164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-46c6dc48-17c6-4c62-8e31-e0be19ce8266 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:31.622449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-46c6dc48-17c6-4c62-8e31-e0be19ce8266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:31.643092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:31.718583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:32.000494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa44adb-9756-4e71-b746-1e18ef4112ed None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:32.002047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5aa44adb-9756-4e71-b746-1e18ef4112ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:32.103734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa44adb-9756-4e71-b746-1e18ef4112ed None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:32.123683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:32.176311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:32.176915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:32.177196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:32.177468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:32.179047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:32.285917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:32.287275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec06b1f-741c-4fa9-9f20-bf18e5e8a05c service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:32.305291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 732/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:34.254925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235a62-842b-4965-a2ca-71d43b651c10 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:34.255479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235a62-842b-4965-a2ca-71d43b651c10 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:34.255479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235a62-842b-4965-a2ca-71d43b651c10 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:34.256842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:34.262628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c320f-1809-4143-9ac2-e354c648416b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:34.263039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c320f-1809-4143-9ac2-e354c648416b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:34.263188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c320f-1809-4143-9ac2-e354c648416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:34.326449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:34.329339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-974c320f-1809-4143-9ac2-e354c648416b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:34.331075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-974c320f-1809-4143-9ac2-e354c648416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:34.424792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:14:34.709607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235a62-842b-4965-a2ca-71d43b651c10 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:34.711825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0b235a62-842b-4965-a2ca-71d43b651c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:34.814104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235a62-842b-4965-a2ca-71d43b651c10 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:34.861316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:34.885869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:34.886465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:34.886739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:34.887006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:34.888613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:34.994252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:34.995699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a8443-2c29-406e-a776-109e96e17e51 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:35.015705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 722/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:36.986453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cb06c-8c4e-430a-9703-a21c81c3c4c3 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:36.986985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cb06c-8c4e-430a-9703-a21c81c3c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:36.986985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cb06c-8c4e-430a-9703-a21c81c3c4c3 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:36.988386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:36.994359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ab059-d22c-47e6-9731-47bc21642c8d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:36.994765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ab059-d22c-47e6-9731-47bc21642c8d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:36.994953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ab059-d22c-47e6-9731-47bc21642c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:37.060164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f60ab059-d22c-47e6-9731-47bc21642c8d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:37.061385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f60ab059-d22c-47e6-9731-47bc21642c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:37.089445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:37.156491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:37.440252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cb06c-8c4e-430a-9703-a21c81c3c4c3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:37.441781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-704cb06c-8c4e-430a-9703-a21c81c3c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:37.542748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cb06c-8c4e-430a-9703-a21c81c3c4c3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:37.571226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:37.614162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:37.614761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:37.615038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:37.615306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:37.617515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:37.722837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:37.724327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697b88-7a42-4d99-a81b-ff6405338314 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:37.744679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 735/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:39.667409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2436f5-768f-4b49-a2d6-a92ce101a092 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:39.668022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2436f5-768f-4b49-a2d6-a92ce101a092 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:39.668022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2436f5-768f-4b49-a2d6-a92ce101a092 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:39.669447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:39.674915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea8b5a-223c-4937-a549-92c85d5fa1e8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:39.675344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea8b5a-223c-4937-a549-92c85d5fa1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:39.675448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea8b5a-223c-4937-a549-92c85d5fa1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:39.743507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-38ea8b5a-223c-4937-a549-92c85d5fa1e8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:39.744750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-38ea8b5a-223c-4937-a549-92c85d5fa1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:39.753021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:39.840173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:40.128921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2436f5-768f-4b49-a2d6-a92ce101a092 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:40.130466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ed2436f5-768f-4b49-a2d6-a92ce101a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:40.233185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2436f5-768f-4b49-a2d6-a92ce101a092 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:40.287105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:40.306267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:40.306864 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:40.307394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:40.307664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:40.309282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:40.413723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:40.415072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1dc07-1826-477c-809e-67da9b88b95e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:40.433634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 725/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:42.365314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4ddf-060c-4a19-98d6-c2cb8acece10 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:42.365879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4ddf-060c-4a19-98d6-c2cb8acece10 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:42.365879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4ddf-060c-4a19-98d6-c2cb8acece10 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:42.367268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:42.372664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b9a3-fd75-4668-a049-b9dab4fd0988 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:42.373123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b9a3-fd75-4668-a049-b9dab4fd0988 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:42.373231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b9a3-fd75-4668-a049-b9dab4fd0988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:42.439296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7832b9a3-fd75-4668-a049-b9dab4fd0988 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:42.440541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7832b9a3-fd75-4668-a049-b9dab4fd0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:42.481059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:42.539904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:42.832720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4ddf-060c-4a19-98d6-c2cb8acece10 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:42.834309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-159b4ddf-060c-4a19-98d6-c2cb8acece10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:42.936091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4ddf-060c-4a19-98d6-c2cb8acece10 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:42.972681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:43.009151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:43.009765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:43.010076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:43.010349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:43.011974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:43.120927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:43.122368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324bf47-d094-4fac-9487-39b8177e7958 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:43.140228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 738/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:45.053900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fae4-1dc0-4443-a105-5be445f843b7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:45.054392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fae4-1dc0-4443-a105-5be445f843b7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:45.054585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fae4-1dc0-4443-a105-5be445f843b7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:45.055987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:45.061343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b46d-1fc2-4ec7-bbe3-8c1e6847ed3e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:45.061759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b46d-1fc2-4ec7-bbe3-8c1e6847ed3e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:45.061892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b46d-1fc2-4ec7-bbe3-8c1e6847ed3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:45.126331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2b62b46d-1fc2-4ec7-bbe3-8c1e6847ed3e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:45.127524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2b62b46d-1fc2-4ec7-bbe3-8c1e6847ed3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:45.144857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:45.223420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:45.505630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965fae4-1dc0-4443-a105-5be445f843b7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:45.507724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7965fae4-1dc0-4443-a105-5be445f843b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:45.608873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965fae4-1dc0-4443-a105-5be445f843b7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:45.673615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:45.681120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:45.681727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:45.682265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:45.682538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:45.684189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:45.792149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:45.793529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e4ed-98dd-435b-9e42-cf9c6fd37061 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:45.811743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 728/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:47.713460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68f7c-93df-4c66-a6fc-1c2795d4c805 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:47.714038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68f7c-93df-4c66-a6fc-1c2795d4c805 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:47.714144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68f7c-93df-4c66-a6fc-1c2795d4c805 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:47.715450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:14:47.720625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c4cf-166b-4803-985c-84ecb55d5406 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:47.721061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c4cf-166b-4803-985c-84ecb55d5406 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:47.721165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c4cf-166b-4803-985c-84ecb55d5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:47.786921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b7a2c4cf-166b-4803-985c-84ecb55d5406 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:14:47.788692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7a2c4cf-166b-4803-985c-84ecb55d5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:47.836590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:47.884148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:14:48.163685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68f7c-93df-4c66-a6fc-1c2795d4c805 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:14:48.165254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f4b68f7c-93df-4c66-a6fc-1c2795d4c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:48.267456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68f7c-93df-4c66-a6fc-1c2795d4c805 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:14:48.314512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:48.339660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:14:48.340289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:14:48.340565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:14:48.340830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:14:48.342398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:14:48.569371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:14:48.570816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f0d8e-5b45-44a7-82e6-e318563ed8d5 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:14:48.588439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 741/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:57.882233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=22 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:58.586160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=66 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:07.868828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a018699-28d4-4b85-a2d0-74c86349e09d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:07.869375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a018699-28d4-4b85-a2d0-74c86349e09d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:07.869375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a018699-28d4-4b85-a2d0-74c86349e09d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:07.870712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 730/1471] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:07.875777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d279f-90d4-4bf6-bd9c-95b00511b139 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:07.876245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d279f-90d4-4bf6-bd9c-95b00511b139 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:07.876357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d279f-90d4-4bf6-bd9c-95b00511b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:07.942047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1c3d279f-90d4-4bf6-bd9c-95b00511b139 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:07.943278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1c3d279f-90d4-4bf6-bd9c-95b00511b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:08.037854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 742/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:08.334849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc631ce-bbf7-40d3-aa96-25e1eca79a35 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:08.335131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc631ce-bbf7-40d3-aa96-25e1eca79a35 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:08.335405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc631ce-bbf7-40d3-aa96-25e1eca79a35 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:08.336870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 731/1473] 10.222.0.23 () {54 vars in 967 bytes} [Wed Aug 17 14:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:08.341751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94412-8b30-4c1e-b29c-48a60c3127d4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:08.342164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94412-8b30-4c1e-b29c-48a60c3127d4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:08.342449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94412-8b30-4c1e-b29c-48a60c3127d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:08.418337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e7c94412-8b30-4c1e-b29c-48a60c3127d4 None None] MFA Rules not processed for user `3fb472deed9140dcbb47301a3871a21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:08.420033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e7c94412-8b30-4c1e-b29c-48a60c3127d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:08.440220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:08.496975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 743/1474] 10.222.0.23 () {58 vars in 1064 bytes} [Wed Aug 17 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:08.504690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc631ce-bbf7-40d3-aa96-25e1eca79a35 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:08.506822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3cc631ce-bbf7-40d3-aa96-25e1eca79a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:08.611240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc631ce-bbf7-40d3-aa96-25e1eca79a35 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:08.684981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:08.685599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:08.685880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:08.686151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:08.687794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:08.742491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:08.797852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:08.799421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d5276-6d8d-41ce-bde3-d0dc172b1460 service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:08.819588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 732/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:15:10.796439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771c37-c6d8-41ca-a9a4-8f96d7178498 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:10.796996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771c37-c6d8-41ca-a9a4-8f96d7178498 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:10.796996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771c37-c6d8-41ca-a9a4-8f96d7178498 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:10.798309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 744/1476] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:10.804066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09116-e64a-4506-88f1-35a482943ba6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:10.804542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09116-e64a-4506-88f1-35a482943ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:10.804640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09116-e64a-4506-88f1-35a482943ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:10.868852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-45a09116-e64a-4506-88f1-35a482943ba6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:10.869957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-45a09116-e64a-4506-88f1-35a482943ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:10.964669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 733/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:11.235489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771c37-c6d8-41ca-a9a4-8f96d7178498 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:11.237057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-35771c37-c6d8-41ca-a9a4-8f96d7178498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:11.360708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771c37-c6d8-41ca-a9a4-8f96d7178498 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:11.408464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:11.452527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:11.453129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:11.453407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:11.453679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:11.454312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:11.456061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:15:11.456061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:15:11.456061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:15:11.457195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a73c-16d4-4bd0-859f-22cc600699d3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:11.476494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 745/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Aug 17 14:15:11 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:15:13.391026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd528e-9abc-4ef2-9f26-841b094acb4d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:13.391533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd528e-9abc-4ef2-9f26-841b094acb4d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:13.391533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd528e-9abc-4ef2-9f26-841b094acb4d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:13.392861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 734/1479] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:13.398562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568bf25-6e72-442e-b365-23f0e48bbb4e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:13.398984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568bf25-6e72-442e-b365-23f0e48bbb4e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:13.399148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568bf25-6e72-442e-b365-23f0e48bbb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:13.465030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1568bf25-6e72-442e-b365-23f0e48bbb4e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:13.466254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1568bf25-6e72-442e-b365-23f0e48bbb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:13.561385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 746/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:13.852770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd528e-9abc-4ef2-9f26-841b094acb4d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:13.854659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-86cd528e-9abc-4ef2-9f26-841b094acb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:13.864942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:13.998287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd528e-9abc-4ef2-9f26-841b094acb4d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:14.076497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:14.110739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:14.111348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:14.111626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:14.111895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:14.113542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:14.203523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:14.205160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441c3a7-2b72-48cd-bb2f-c28de56c2c98 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:14.222632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 735/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:15:16.301483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b6b2-6fe0-490b-b3ee-ae109daa02c0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:16.302041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b6b2-6fe0-490b-b3ee-ae109daa02c0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:16.302041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b6b2-6fe0-490b-b3ee-ae109daa02c0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:16.303363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 747/1482] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:16.308895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b06f-1acf-415d-886c-190adf121dbb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:16.309282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b06f-1acf-415d-886c-190adf121dbb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:16.309435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b06f-1acf-415d-886c-190adf121dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:16.373575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fcf4b06f-1acf-415d-886c-190adf121dbb None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:16.374773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fcf4b06f-1acf-415d-886c-190adf121dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:16.420716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:16.470913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 736/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:16.759396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b6b2-6fe0-490b-b3ee-ae109daa02c0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:16.760966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6c66b6b2-6fe0-490b-b3ee-ae109daa02c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:16.785137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:16.863765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b6b2-6fe0-490b-b3ee-ae109daa02c0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:16.936437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:16.937033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:16.937308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:16.937575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:16.939146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:17.011451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:17.047147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:17.048641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fd68-b068-4086-b6f1-8e4deb6973ad service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:17.068046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 748/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:15:19.027767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4fa0-5745-4c16-a48d-1bee49ba4043 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:19.028264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4fa0-5745-4c16-a48d-1bee49ba4043 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:19.028372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4fa0-5745-4c16-a48d-1bee49ba4043 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:19.029733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 737/1485] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:19.034766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c848e-37af-4552-a4af-822e58091614 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:19.035180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c848e-37af-4552-a4af-822e58091614 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:19.035860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c848e-37af-4552-a4af-822e58091614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:19.100669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ec9c848e-37af-4552-a4af-822e58091614 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:19.101914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec9c848e-37af-4552-a4af-822e58091614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:19.203768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 749/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:19.490992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4fa0-5745-4c16-a48d-1bee49ba4043 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:19.492570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-021e4fa0-5745-4c16-a48d-1bee49ba4043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:19.597569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4fa0-5745-4c16-a48d-1bee49ba4043 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:19.668898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:19.670631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:19.671240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:19.671723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:19.672205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:19.674064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:19.783027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:19.784508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eebb4-337b-48c0-80c2-c5993fac3106 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:19.803119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 738/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:15:21.788838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b0183-883f-4454-a680-3a0bae227c7b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:21.789365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b0183-883f-4454-a680-3a0bae227c7b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:21.789479 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b0183-883f-4454-a680-3a0bae227c7b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:21.790776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 750/1488] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:21.796072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f4d6-852e-40cf-8caf-9d91d880d74c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:21.796496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f4d6-852e-40cf-8caf-9d91d880d74c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:21.796614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f4d6-852e-40cf-8caf-9d91d880d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:21.864715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7a91f4d6-852e-40cf-8caf-9d91d880d74c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:21.865932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7a91f4d6-852e-40cf-8caf-9d91d880d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:21.918000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:21.962377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 739/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:22.257229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b0183-883f-4454-a680-3a0bae227c7b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:22.258809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-437b0183-883f-4454-a680-3a0bae227c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:22.293811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:22.360290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b0183-883f-4454-a680-3a0bae227c7b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:22.433457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:22.434063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:22.434342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:22.434610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:22.436226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:22.512737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:22.544502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:22.545936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dafbd1-3fdd-4d16-be0b-e21b8963bb9e service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:22.564665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 751/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:15:24.648098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270483-90e8-4cc1-b54a-f499ba167430 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:24.648657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270483-90e8-4cc1-b54a-f499ba167430 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:24.648657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270483-90e8-4cc1-b54a-f499ba167430 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:24.649997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 740/1491] 10.222.0.23 () {54 vars in 927 bytes} [Wed Aug 17 14:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:15:24.655232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2a02-a116-4b86-b541-4e0dc79625f5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:24.655633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2a02-a116-4b86-b541-4e0dc79625f5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:24.655780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2a02-a116-4b86-b541-4e0dc79625f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:24.721401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-456b2a02-a116-4b86-b541-4e0dc79625f5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:15:24.723187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-456b2a02-a116-4b86-b541-4e0dc79625f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:24.819568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 752/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 17 14:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:15:25.105763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e270483-90e8-4cc1-b54a-f499ba167430 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:15:25.107338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e270483-90e8-4cc1-b54a-f499ba167430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:25.214388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e270483-90e8-4cc1-b54a-f499ba167430 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:15:25.286588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:15:25.287122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:15:25.287418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:15:25.287668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:15:25.289289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:15:25.298092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:25.396922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:15:25.398383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1435e8-f14d-4bfd-9fc7-c52918195fae service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:15:25.415944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 741/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:15:34.817797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:35.413747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=50 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:40.480643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:40.481233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:40.481233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:40.558187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:16:40.559401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:40.656220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 753/1494] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:16:40.664208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:40.664727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:40.664842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:40.738770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:16:40.739990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:40.838530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 742/1495] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:16:40.843387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:40.844677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:40.855810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0d080-5a2b-4b8b-8229-a8431fd159fd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:40.915425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:40.948065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:40.948669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:40.948946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:40.949216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:40.949857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:16:40.950154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:40.951158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:40.951158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:16:40.951158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:16:40.952161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:40.962868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 754/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:16:40.971846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:40.980956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb873-23f9-46eb-b64e-e42008c28fa1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:41.040700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:41.075192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:41.075823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.076139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.076406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.077518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:41.079219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:41.079219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:16:41.079219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:16:41.080433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:41.137614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 743/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:16:40 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:16:41.142359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:41.143883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:41.176508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b406b-0e9c-4ccd-b325-228b52a033f6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:41.269324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:41.269917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.270192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.270472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.271072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:41.272096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:41.272096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:16:41.272096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:16:41.273302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:41.313726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 755/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:16:41 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:16:41.317652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:41.319179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:41.379442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1308a-d823-4572-91c0-2aeeade5b86a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:41.462522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:41.473818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:41.474424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.474699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.474965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.475600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:41.476647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:41.476647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:16:41.476647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:16:41.477541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:41.489576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 744/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:16:41.493719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:41.495263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:41.507145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaf05-810d-445e-a96e-736077afd0a6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:41.532382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:41.601750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:41.602281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.602557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.602824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.603462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:41.604477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:41.604477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:16:41.604477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:16:41.605363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a4db1-5367-47c1-a340-c9584814ab86 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:41.617632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 756/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:16:41.621796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:41.623312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:41.656775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4a0a7-b9df-4f6a-be80-55e671e1dba2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:41.753387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:41.754051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.754329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.754599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] PATH_INFO: `/v3/projects/1232fb860db64755a64d95e61d867bb5/users/4be9d33015594c228a287bbdfe9f2273/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.776898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1232fb860db64755a64d95e61d867bb5, user_id=4be9d33015594c228a287bbdfe9f2273, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:41.777928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:41.777928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:16:41.777928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:16:41.779911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2981d-fdd9-48b8-b290-16fdac26352e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:41.804041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 745/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:16:41 2022] PUT /identity/v3/projects/1232fb860db64755a64d95e61d867bb5/users/4be9d33015594c228a287bbdfe9f2273/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:16:41.816772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9e9d-2b80-4dea-b90e-b4487bf2f47f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.817060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9e9d-2b80-4dea-b90e-b4487bf2f47f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.817364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9e9d-2b80-4dea-b90e-b4487bf2f47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.871992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b03c9e9d-2b80-4dea-b90e-b4487bf2f47f None None] MFA Rules not processed for user `4be9d33015594c228a287bbdfe9f2273`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:16:41.873128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b03c9e9d-2b80-4dea-b90e-b4487bf2f47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:41.949349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 757/1502] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:16:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:16:41.962590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66e993-aa13-4ab8-92a5-bd150f581449 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.962876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66e993-aa13-4ab8-92a5-bd150f581449 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.963154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66e993-aa13-4ab8-92a5-bd150f581449 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:41.964532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 746/1503] 10.222.0.23 () {54 vars in 964 bytes} [Wed Aug 17 14:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:16:41.969187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1f52-89c4-4403-bc15-85ce49a8f771 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:41.969489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1f52-89c4-4403-bc15-85ce49a8f771 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:41.969759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1f52-89c4-4403-bc15-85ce49a8f771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:42.000472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:42.043813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a6ff1f52-89c4-4403-bc15-85ce49a8f771 None None] MFA Rules not processed for user `4bd62078f127457392fa0dd755ed1a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:16:42.045056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a6ff1f52-89c4-4403-bc15-85ce49a8f771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:42.119832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 758/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Wed Aug 17 14:16:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:16:42.128196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66e993-aa13-4ab8-92a5-bd150f581449 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:42.129670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da66e993-aa13-4ab8-92a5-bd150f581449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:42.180683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:42.236477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66e993-aa13-4ab8-92a5-bd150f581449 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:42.307706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:42.308340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:42.308620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:42.308891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:42.310490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:42.406655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:42.408057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:42.411533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:42.426284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 747/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:16:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:16:42.471849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e640-db56-4b9d-9156-6ffa282eb959 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:42.472183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e640-db56-4b9d-9156-6ffa282eb959 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:42.472486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e640-db56-4b9d-9156-6ffa282eb959 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:42.473792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 759/1506] 10.222.0.23 () {52 vars in 830 bytes} [Wed Aug 17 14:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:16:42.477801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:42.480054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:42.578201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca81c1-b315-4a6b-9fd0-bb776cfcece5 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:42.668774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:42.669323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:42.669599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:42.669866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] PATH_INFO: `/v3/users/4be9d33015594c228a287bbdfe9f2273` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:42.682373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be9d33015594c228a287bbdfe9f2273)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:42.683412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:42.683412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:16:42.683412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:16:42.684681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:42.694372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:42.751225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be9d33015594c228a287bbdfe9f2273'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:42.751659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be9d33015594c228a287bbdfe9f2273'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:42.752212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be9d33015594c228a287bbdfe9f2273'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:42.775129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be9d33015594c228a287bbdfe9f2273'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:42.790923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be9d33015594c228a287bbdfe9f2273'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:42.805271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 748/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:16:42 2022] DELETE /identity/v3/users/4be9d33015594c228a287bbdfe9f2273 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:16:42.809626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:42.810123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:42.810230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:42.865881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:16:42.867093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:42.940933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:42.953848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 760/1508] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:16:42.963927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:42.965188 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:43.069268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82138f0-e75c-4502-b90d-77e5bdb7ad2f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:43.123093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:43.143448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:43.144099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:43.144381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:43.144680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:43.146287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:43.252158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:43.253601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7f9e1-08de-4f33-98b0-41f9640ba57f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:43.272068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 749/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:16:43.686536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:16:43.687740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:16:43.698990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395d93-3feb-4c49-9ac2-430247fce043 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:16:43.802537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:16:43.803162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:16:43.803689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:16:43.803972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] PATH_INFO: `/v3/projects/1232fb860db64755a64d95e61d867bb5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:16:43.813689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1232fb860db64755a64d95e61d867bb5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:16:43.814793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:16:43.814793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:16:43.814793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:16:43.816204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:16:43.873005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1232fb860db64755a64d95e61d867bb5', 'request_id': 'req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:43.878999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1232fb860db64755a64d95e61d867bb5', 'request_id': 'req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:43.887805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1232fb860db64755a64d95e61d867bb5', 'request_id': 'req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:43.917676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] The token cache is being invalidate because project 1232fb860db64755a64d95e61d867bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:16:43.917961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:43.918481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-250e99bf-fa8d-4a78-9e9f-2548bcd978a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:16:43.919784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 761/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:16:43 2022] DELETE /identity/v3/projects/1232fb860db64755a64d95e61d867bb5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:16:53.269799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=62 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:16:53.915672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:21.186675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1fc8-b7a8-43a7-8f5a-77f542ab30fd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:21.187281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1fc8-b7a8-43a7-8f5a-77f542ab30fd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:21.187534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1fc8-b7a8-43a7-8f5a-77f542ab30fd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:21.189458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:18:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:21.194775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a45ab-08de-4b79-bf1a-1656c04272ce None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:21.195220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a45ab-08de-4b79-bf1a-1656c04272ce None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:21.195322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a45ab-08de-4b79-bf1a-1656c04272ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:21.273191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-634a45ab-08de-4b79-bf1a-1656c04272ce None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:21.274382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-634a45ab-08de-4b79-bf1a-1656c04272ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:21.374522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:21.530515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1fc8-b7a8-43a7-8f5a-77f542ab30fd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:21.532626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-61da1fc8-b7a8-43a7-8f5a-77f542ab30fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:21.648303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1fc8-b7a8-43a7-8f5a-77f542ab30fd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:21.654257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab87e-03a7-45ad-b16d-884e9fbf46f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:21.654861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab87e-03a7-45ad-b16d-884e9fbf46f8 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:21.655144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab87e-03a7-45ad-b16d-884e9fbf46f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:21.655413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab87e-03a7-45ad-b16d-884e9fbf46f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:21.663385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab87e-03a7-45ad-b16d-884e9fbf46f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:21.664997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab87e-03a7-45ad-b16d-884e9fbf46f8 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:21.675707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 751/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:22.512158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6de626-d15c-4083-825a-38ab41f28517 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:22.512730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6de626-d15c-4083-825a-38ab41f28517 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:22.512730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6de626-d15c-4083-825a-38ab41f28517 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:22.514063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:22.518981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1d41-6f57-4456-b8b3-4eed00efedf9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:22.519393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1d41-6f57-4456-b8b3-4eed00efedf9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:22.519555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1d41-6f57-4456-b8b3-4eed00efedf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:22.539011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-48ea1d41-6f57-4456-b8b3-4eed00efedf9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:22.540310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48ea1d41-6f57-4456-b8b3-4eed00efedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:22.548711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:22.699326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6de626-d15c-4083-825a-38ab41f28517 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:22.714102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6de626-d15c-4083-825a-38ab41f28517 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:22.720392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefe6c6-ff15-4dd1-92e7-b77efa82b844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:22.721002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6c6-ff15-4dd1-92e7-b77efa82b844 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:22.721285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6c6-ff15-4dd1-92e7-b77efa82b844 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:22.721560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6c6-ff15-4dd1-92e7-b77efa82b844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:22.733514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefe6c6-ff15-4dd1-92e7-b77efa82b844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:22.735200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefe6c6-ff15-4dd1-92e7-b77efa82b844 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:22.745221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 764/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:23.183529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020be0a-238a-4930-85fe-6b1548040314 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:23.184414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020be0a-238a-4930-85fe-6b1548040314 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:23.184711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020be0a-238a-4930-85fe-6b1548040314 None None] PATH_INFO: `/v3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:23.186002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 753/1517] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 17 14:18:23 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:18:23.200160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3193-7942-40ac-8c2d-dfa03691483f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:23.200459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3193-7942-40ac-8c2d-dfa03691483f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:23.200763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3193-7942-40ac-8c2d-dfa03691483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:23.258123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c1ea3193-7942-40ac-8c2d-dfa03691483f None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:23.259334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c1ea3193-7942-40ac-8c2d-dfa03691483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:23.276504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:23.330756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 765/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 17 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:27.150053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68367644-c1a1-420c-83c1-595bd0314f0e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:27.150515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68367644-c1a1-420c-83c1-595bd0314f0e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:27.150618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68367644-c1a1-420c-83c1-595bd0314f0e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:27.152037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 754/1519] 10.222.0.23 () {54 vars in 961 bytes} [Wed Aug 17 14:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:27.157238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935ff7-e11c-4ad6-b01c-892469e94126 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:27.157663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935ff7-e11c-4ad6-b01c-892469e94126 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:27.157776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935ff7-e11c-4ad6-b01c-892469e94126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:27.178908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b7935ff7-e11c-4ad6-b01c-892469e94126 None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:27.180154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7935ff7-e11c-4ad6-b01c-892469e94126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:27.189955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 766/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Aug 17 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:27.197223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68367644-c1a1-420c-83c1-595bd0314f0e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:27.210663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68367644-c1a1-420c-83c1-595bd0314f0e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:27.215620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8206a71-62fa-4163-8fea-940540e0c3af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:27.219271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206a71-62fa-4163-8fea-940540e0c3af service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:27.219393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206a71-62fa-4163-8fea-940540e0c3af service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:27.219598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206a71-62fa-4163-8fea-940540e0c3af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:27.228374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8206a71-62fa-4163-8fea-940540e0c3af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:27.229965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8206a71-62fa-4163-8fea-940540e0c3af service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:27.239975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 755/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:33.967373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666104-591b-430d-8848-554deb098b90 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:33.967917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666104-591b-430d-8848-554deb098b90 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:33.967917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666104-591b-430d-8848-554deb098b90 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:33.969876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:33.974569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e46307-3f55-4b6e-9643-9cd34223f0e1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:33.975016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e46307-3f55-4b6e-9643-9cd34223f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:33.975226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e46307-3f55-4b6e-9643-9cd34223f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:33.995231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f0e46307-3f55-4b6e-9643-9cd34223f0e1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:33.996381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f0e46307-3f55-4b6e-9643-9cd34223f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:34.004031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:34.156909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666104-591b-430d-8848-554deb098b90 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:34.171362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666104-591b-430d-8848-554deb098b90 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:34.177622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2b82-a3e7-4b8e-88f0-f664c2296574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:34.178330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2b82-a3e7-4b8e-88f0-f664c2296574 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:34.178618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2b82-a3e7-4b8e-88f0-f664c2296574 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:34.178891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2b82-a3e7-4b8e-88f0-f664c2296574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:34.186796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a2b82-a3e7-4b8e-88f0-f664c2296574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:34.188489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a2b82-a3e7-4b8e-88f0-f664c2296574 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:34.197676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 768/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:35.023054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583432a-77e9-4302-bf70-1832700b8b7b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:35.023591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583432a-77e9-4302-bf70-1832700b8b7b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:35.023591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583432a-77e9-4302-bf70-1832700b8b7b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:35.024898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 14:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:35.029661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f90d-1a25-4b15-9f05-62ac8ebc15eb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:35.030104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f90d-1a25-4b15-9f05-62ac8ebc15eb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:35.030212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f90d-1a25-4b15-9f05-62ac8ebc15eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:35.048916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8e90f90d-1a25-4b15-9f05-62ac8ebc15eb None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:35.050370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8e90f90d-1a25-4b15-9f05-62ac8ebc15eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:35.058101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:35.210816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583432a-77e9-4302-bf70-1832700b8b7b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:35.224918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583432a-77e9-4302-bf70-1832700b8b7b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:35.230646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc25f9-0f05-4b33-ab69-12d7bc6760a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:35.231274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc25f9-0f05-4b33-ab69-12d7bc6760a9 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:35.231552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc25f9-0f05-4b33-ab69-12d7bc6760a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:35.231821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc25f9-0f05-4b33-ab69-12d7bc6760a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:35.240481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc25f9-0f05-4b33-ab69-12d7bc6760a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:35.242073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc25f9-0f05-4b33-ab69-12d7bc6760a9 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:35.251922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 758/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:39.252870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3d0f-87e2-4127-9eaf-2ca91679a718 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:39.253428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3d0f-87e2-4127-9eaf-2ca91679a718 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:39.253428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3d0f-87e2-4127-9eaf-2ca91679a718 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:39.254781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:39.260040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31ddfc-7b8b-4b99-8179-4dd90295fb7f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:39.260430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31ddfc-7b8b-4b99-8179-4dd90295fb7f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:39.260593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31ddfc-7b8b-4b99-8179-4dd90295fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:39.280082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2f31ddfc-7b8b-4b99-8179-4dd90295fb7f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:39.281853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f31ddfc-7b8b-4b99-8179-4dd90295fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:39.289756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:39.572356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3d0f-87e2-4127-9eaf-2ca91679a718 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:39.574074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dbae3d0f-87e2-4127-9eaf-2ca91679a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:39.649835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3d0f-87e2-4127-9eaf-2ca91679a718 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:39.653373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7af8ef-ac3f-46c2-bd19-67289104fc59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:39.653973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7af8ef-ac3f-46c2-bd19-67289104fc59 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:39.654252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7af8ef-ac3f-46c2-bd19-67289104fc59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:39.654521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7af8ef-ac3f-46c2-bd19-67289104fc59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:39.663130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7af8ef-ac3f-46c2-bd19-67289104fc59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:39.664593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7af8ef-ac3f-46c2-bd19-67289104fc59 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:39.673687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 771/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:41.536669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8c2cb-db39-4592-830f-e785c1963eed None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:41.537230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8c2cb-db39-4592-830f-e785c1963eed None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:41.537230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8c2cb-db39-4592-830f-e785c1963eed None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:41.538550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:41.543773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816cf9f-f667-453c-92b6-3c7f99261584 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:41.544234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816cf9f-f667-453c-92b6-3c7f99261584 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:41.544337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816cf9f-f667-453c-92b6-3c7f99261584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:41.563445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a816cf9f-f667-453c-92b6-3c7f99261584 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:41.564669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a816cf9f-f667-453c-92b6-3c7f99261584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:41.572406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:41.856838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8c2cb-db39-4592-830f-e785c1963eed None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:41.859170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0fb8c2cb-db39-4592-830f-e785c1963eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:41.872029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8c2cb-db39-4592-830f-e785c1963eed None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:41.875532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a419ed-2b63-45bf-b1ea-127f4d79f9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:41.876189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a419ed-2b63-45bf-b1ea-127f4d79f9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:41.876442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a419ed-2b63-45bf-b1ea-127f4d79f9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:41.876716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a419ed-2b63-45bf-b1ea-127f4d79f9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:41.885416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a419ed-2b63-45bf-b1ea-127f4d79f9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:41.886833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a419ed-2b63-45bf-b1ea-127f4d79f9b4 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:41.896075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 761/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:45.653111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd63037-0f34-45e6-a299-ac400755f2e6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:45.653678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd63037-0f34-45e6-a299-ac400755f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:45.653678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd63037-0f34-45e6-a299-ac400755f2e6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:45.655503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:45.660646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcfd77-4f23-49a8-97d5-83591dc92476 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:45.661098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcfd77-4f23-49a8-97d5-83591dc92476 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:45.661268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcfd77-4f23-49a8-97d5-83591dc92476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:45.668842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:45.682415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eebcfd77-4f23-49a8-97d5-83591dc92476 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:45.683624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eebcfd77-4f23-49a8-97d5-83591dc92476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:45.691526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:46.236166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd63037-0f34-45e6-a299-ac400755f2e6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:46.237857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ffd63037-0f34-45e6-a299-ac400755f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:46.302448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:46.315998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd63037-0f34-45e6-a299-ac400755f2e6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:46.319467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff967b-2de1-4fda-b077-a463ea448a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:46.320106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff967b-2de1-4fda-b077-a463ea448a5b service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:46.320385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff967b-2de1-4fda-b077-a463ea448a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:46.320654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff967b-2de1-4fda-b077-a463ea448a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:46.329850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff967b-2de1-4fda-b077-a463ea448a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:46.331266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff967b-2de1-4fda-b077-a463ea448a5b service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:46.340329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 774/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:48.249797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f548b3-f35b-4c23-98de-5f857c1ae665 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:48.250357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f548b3-f35b-4c23-98de-5f857c1ae665 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:48.250357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f548b3-f35b-4c23-98de-5f857c1ae665 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:48.251697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 14:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:18:48.256842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baba5b-417e-4630-947a-5ab2d778f59a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:48.257223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baba5b-417e-4630-947a-5ab2d778f59a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:48.257397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baba5b-417e-4630-947a-5ab2d778f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:48.276205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f2baba5b-417e-4630-947a-5ab2d778f59a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:18:48.277398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2baba5b-417e-4630-947a-5ab2d778f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:48.285201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:18:48.825763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f548b3-f35b-4c23-98de-5f857c1ae665 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:18:48.827943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-61f548b3-f35b-4c23-98de-5f857c1ae665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:18:48.840858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f548b3-f35b-4c23-98de-5f857c1ae665 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:18:48.845045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac11c3-23f3-4c9a-9720-b26f43626481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:18:48.845630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac11c3-23f3-4c9a-9720-b26f43626481 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:18:48.845901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac11c3-23f3-4c9a-9720-b26f43626481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:18:48.846167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac11c3-23f3-4c9a-9720-b26f43626481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:18:48.854811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac11c3-23f3-4c9a-9720-b26f43626481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:18:48.856254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac11c3-23f3-4c9a-9720-b26f43626481 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:18:48.865375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 764/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:18:58.271519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=11 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:58.861311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=8 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:18.547824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.548578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.548578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.577126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:18.578597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:18.586809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 776/1540] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:18.601376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.602459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.603040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.632110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:18.633720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:18.645254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 765/1541] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:18.652374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:18.665276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621fd01-819f-41db-a867-1c8886f5a96f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:18.673737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:18.674362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.674644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.674918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.675578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:18.675882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:18.677520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f06156-225f-4b7c-93ae-5da40367735c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:18.699968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 777/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:18.713038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:18.726213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383c3a-75fe-46d8-963b-3492ee0c6ba7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:18.735997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:18.737009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.737542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.739133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.740031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:18.742551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:18.768894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4d46-3007-4342-81fc-9d64febabf23 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.769266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4d46-3007-4342-81fc-9d64febabf23 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.769465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4d46-3007-4342-81fc-9d64febabf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.814462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 766/1543] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:18.817104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-971d4d46-3007-4342-81fc-9d64febabf23 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:18.818341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-971d4d46-3007-4342-81fc-9d64febabf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:18.818726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:18.926590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086ad70-34bd-4d92-b356-d4ce126eb4b4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:18.932666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:18.933587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.934099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.934588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.935424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:18.936716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:20:18.936716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:20:18.936716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:20:18.939858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb5116-3f00-4e5b-bbbf-32842cfe6aad admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:18.950094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 778/1544] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:18.951369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb704-90e6-4980-8ade-dedf86e0003c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.951658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb704-90e6-4980-8ade-dedf86e0003c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.952013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb704-90e6-4980-8ade-dedf86e0003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.965165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 767/1545] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:18.966913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467978a-6402-4186-92ef-0e1fdc0c6e2a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.967416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467978a-6402-4186-92ef-0e1fdc0c6e2a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.967903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467978a-6402-4186-92ef-0e1fdc0c6e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.972411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a82cb704-90e6-4980-8ade-dedf86e0003c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:18.973615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a82cb704-90e6-4980-8ade-dedf86e0003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:18.983518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 779/1546] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:18.984660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186781f-00c5-4876-be15-1d5c201a5a5b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:18.984955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186781f-00c5-4876-be15-1d5c201a5a5b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:18.985225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186781f-00c5-4876-be15-1d5c201a5a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:18.989619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7467978a-6402-4186-92ef-0e1fdc0c6e2a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:18.991026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7467978a-6402-4186-92ef-0e1fdc0c6e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.004760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 768/1547] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.006006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481191-f877-4a16-bb5e-56c81f33fef2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.006135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f186781f-00c5-4876-be15-1d5c201a5a5b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.006333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481191-f877-4a16-bb5e-56c81f33fef2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.006561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481191-f877-4a16-bb5e-56c81f33fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.007314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f186781f-00c5-4876-be15-1d5c201a5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.015879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 780/1548] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.017124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.017407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.017678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.032213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-62481191-f877-4a16-bb5e-56c81f33fef2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.033534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-62481191-f877-4a16-bb5e-56c81f33fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.037041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.038197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.041658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 769/1549] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.043004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d023bc-821d-4bca-923d-c90f7b91d4d2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.043294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d023bc-821d-4bca-923d-c90f7b91d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.043574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d023bc-821d-4bca-923d-c90f7b91d4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.046298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 781/1550] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.048067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.057850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3b09-d698-4f9a-aa26-61f1c240f807 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.062366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac8b7a-2cbc-4099-8195-1122c7d92bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.062958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8b7a-2cbc-4099-8195-1122c7d92bad admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.063235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8b7a-2cbc-4099-8195-1122c7d92bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.063503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8b7a-2cbc-4099-8195-1122c7d92bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.064165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac8b7a-2cbc-4099-8195-1122c7d92bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.065610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-54d023bc-821d-4bca-923d-c90f7b91d4d2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.065867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac8b7a-2cbc-4099-8195-1122c7d92bad admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.066755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54d023bc-821d-4bca-923d-c90f7b91d4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.078858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 770/1551] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.078858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d34cf-27f3-47e2-b066-3847fae693b2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.079626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 782/1552] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:19.079748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d34cf-27f3-47e2-b066-3847fae693b2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.079748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d34cf-27f3-47e2-b066-3847fae693b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.080041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f056b0-4fb3-4a01-a659-ec41f8c52694 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.080041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f056b0-4fb3-4a01-a659-ec41f8c52694 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.080041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f056b0-4fb3-4a01-a659-ec41f8c52694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.096392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3a7d34cf-27f3-47e2-b066-3847fae693b2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.097577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3a7d34cf-27f3-47e2-b066-3847fae693b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.098489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a5f056b0-4fb3-4a01-a659-ec41f8c52694 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.099668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a5f056b0-4fb3-4a01-a659-ec41f8c52694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.105579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 771/1553] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.106804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca70746-16f6-438d-8181-27fc8e2dde96 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.107089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca70746-16f6-438d-8181-27fc8e2dde96 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.107361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca70746-16f6-438d-8181-27fc8e2dde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.108195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 783/1554] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.109613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd1458-02ad-41de-97ff-a529f53f7d78 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.109894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd1458-02ad-41de-97ff-a529f53f7d78 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.110169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd1458-02ad-41de-97ff-a529f53f7d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.129374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2ca70746-16f6-438d-8181-27fc8e2dde96 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.130586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2ca70746-16f6-438d-8181-27fc8e2dde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.134123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-31fd1458-02ad-41de-97ff-a529f53f7d78 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.135303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31fd1458-02ad-41de-97ff-a529f53f7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.138719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 772/1555] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.139879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.140208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.140466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.146958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 784/1556] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.148246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.149341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.149341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.159830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.161067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.168351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.169533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.169671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 773/1557] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.170340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.180678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529dd2-602b-4a5b-89b0-c107d8a310de None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.181811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 785/1558] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.182768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.186611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.187217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.187494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.187765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.188455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.188752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.189765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:20:19.189765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:20:19.189765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:20:19.190648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.192465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b32ec-2dc0-4ede-be8a-f48d06b3b80c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.197622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ba15-b640-424c-8b30-30832dc17732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.198245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ba15-b640-424c-8b30-30832dc17732 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.198528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ba15-b640-424c-8b30-30832dc17732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.198803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ba15-b640-424c-8b30-30832dc17732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.199446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ba15-b640-424c-8b30-30832dc17732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.201076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ba15-b640-424c-8b30-30832dc17732 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.203984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 774/1559] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.204140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.214742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ae04-6cd7-413c-b52f-9c2c35cee8c4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.217477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 786/1560] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:19.218604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.218890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.219165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.219620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.220246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.220761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.221047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.221700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.222004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.223597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.244248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 775/1561] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.244450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.244565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.244668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.247336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 787/1562] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.248164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.248585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08ab1e-f11d-441f-bda8-dd11419804fb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.254251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.254850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.255186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.255459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.256142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.256445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.257919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba40eb-efd9-4378-9e01-80e86c2a65c9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.258045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.262664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.263328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.263687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.264065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.264811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.265148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.266813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.277478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 776/1563] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.277478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.280023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 788/1564] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.280719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.281110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbeb16-70a7-4299-bcbc-eb531611e99c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.285757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.286352 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.286970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.286970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.287656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.288121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.289717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.290545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3488db-a3f5-4c32-93c7-b5b31932684c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.295036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.295618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.295896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.296201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.297130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.297439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.299018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.302379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 777/1565] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.303153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.313270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fe3d1-aed1-48fc-aef1-db71ca9f7483 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.320953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 789/1566] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.320953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.321213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.321213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.321213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.321213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.321648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.321648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.326665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639c17-63ce-433d-990f-c129ecf4b7ba admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.331501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.332186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.332472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.332751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] PATH_INFO: `/v3/projects/613c19b7b0fd4c29b2daa1b26c5d42c3/users/b5872d0410214dd6b44c36c7952a5ea7/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.342380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:19.348668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613c19b7b0fd4c29b2daa1b26c5d42c3, user_id=b5872d0410214dd6b44c36c7952a5ea7, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.349707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:20:19.349707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:20:19.349707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:20:19.351706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.352118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 778/1567] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.352860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.370608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 790/1568] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:19 2022] PUT /identity/v3/projects/613c19b7b0fd4c29b2daa1b26c5d42c3/users/b5872d0410214dd6b44c36c7952a5ea7/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:19.371497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.395941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:19.417904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba0d1d-f7cb-4349-a079-d9cb6efee5c1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.433818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f194d5a-31fd-4f4a-8378-fd869867fa44 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.438724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.439333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.439617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.439922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.440602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:19.440913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.442522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.453791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 791/1569] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:19.454565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.465477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e6fdc-87aa-4474-b278-d78f262cec0e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.470213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.470801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.471086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.471363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.472015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.473022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:20:19.473022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:20:19.473022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:20:19.473835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.474211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.474455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.474737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.475010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.475629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.477578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.502406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 792/1570] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.506309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 779/1571] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.506463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.506574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.567240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0977c-f36c-439b-8a45-06e3cdc48473 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.567845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c0d26-490a-478e-a39a-8e03606249fa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.572748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.572917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.573197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.573546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.573674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.573822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.573967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.574242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.574449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.574865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.576404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.576822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.604553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 780/1572] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.605204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 793/1573] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.605914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.608700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.626090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:19.670097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ae67-7bf0-4739-a40f-015f4e3a33a9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.674358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4486ad-4dd8-42ae-bc8f-dd35e2d88f49 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.675169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3506e-6593-4e67-9009-e04dd4c94bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.675773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3506e-6593-4e67-9009-e04dd4c94bea admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.676075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3506e-6593-4e67-9009-e04dd4c94bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.676347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3506e-6593-4e67-9009-e04dd4c94bea admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.676963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3506e-6593-4e67-9009-e04dd4c94bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.678874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3506e-6593-4e67-9009-e04dd4c94bea admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.679571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.680237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.680521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.680815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.681449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.683361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.702007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 794/1574] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.703361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.703712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.704188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.714024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 781/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.714777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.723048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:19.724272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:19.728700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:19.786546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e803bf-c897-47bd-9592-d9871a7fc8ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.786743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 795/1576] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:19.787126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.791613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.792269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.792536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.792805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.793422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.795746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.799285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfab297-683e-4a69-903b-5921250b9e56 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.803852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.804487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.804769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.805040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.805664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.808136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.824527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 782/1577] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.825254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.831718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 796/1578] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.831718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.839859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4633b-3262-4796-a46c-b1805b63ce12 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.887057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41966bf8-6a61-4c4c-8db0-499ab707c2f0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.891715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.892355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.892660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.892931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.893567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.895629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.896186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.896792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.897074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.897345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.897958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.900431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.921000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 783/1579] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.921209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 797/1580] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.921362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.922235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.931572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dddfa-4a0f-4168-8316-209e99dd8463 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.932361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe97f36-8294-45af-bddc-1f6b824db9a0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.936258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.936835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.937116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.937342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.937452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.937995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.938146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.938352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.938624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.939283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.940055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.940904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:19.951843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 798/1581] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:19.952820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.959852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:19.963797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa0f6e-29ba-46b0-b51a-87db22db97de admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:19.967089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 784/1582] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:19.967813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:19.972059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:19.972730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:19.973018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:19.973291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:19.973901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:19.975831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.000928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 799/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:20.000928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.009957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288151f-36f6-4046-9e19-54c01e91b165 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.015022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.015607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.015886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.016200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.016835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.018724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.026453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37ebd-fdf9-48df-9b24-9af84a7bcd71 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.030562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.031226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.031513 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.031781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.039893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 800/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:19 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:20.040840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.042117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.043777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.050832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc1317-b874-44d3-879a-01812c6e36c2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.054270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 785/1585] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:20.055006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.055333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.056462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.056741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.057010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.057639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.059234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.064752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157d939-b0b1-4d27-bc82-47abf7804346 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.073127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 801/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.073127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.075440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.076106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.076726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.077123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.077997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.079763 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.081302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4507b-3474-4976-9339-1e76562a46b0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.089956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.090685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.091040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.091381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.095131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 786/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.095269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.095382 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.095493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.106102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8112-ce87-42ba-9ddc-2bc1d52b087c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.110174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 802/1588] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.110174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.113687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.114536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.114901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.115423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.116186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.119002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.121330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860c1d-de06-4d31-a08f-1e71c42f6131 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.128482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.129099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.129457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.129727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.130575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.131380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 787/1589] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.132265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.132381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.147642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 803/1590] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.147642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.148002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68bbf8-3cc3-4839-86f8-bdc94c05f37a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.151985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.152446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.152729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.152995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.153673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.155373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.156394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:20.162925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a592b-739a-467f-a5b1-5357292ab39c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.168633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 788/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.171811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.173802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.174540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.174948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.175386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.176133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.178004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.180519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e4ef-968b-4673-8c5d-703dd06395da admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.186006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.186634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.186914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.187185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.187825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.189609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.190214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 804/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.191130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.205004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0bd4-388e-4e65-92c5-ee39ab681635 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.205881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 789/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.206868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.209125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.209734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.210013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.210280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.210914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.212818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.217358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a3bf-e4c9-4fb4-9f5e-23190e1134b5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.222901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.223520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.223798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.224107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.224759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.225498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 805/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.226442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.229924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.240179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be8d0-6608-4544-8e02-160d3cdd998d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.242768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 790/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.243711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.245911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.246767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.247193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.247482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] PATH_INFO: `/v3/projects/8f8124b13faa418583b1bf26bcf3956b/users/18754deb5aa942f9873edb3bb4e82747/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.255570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006373d-91ad-40c2-9edc-c0da57903df1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.261461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.262109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.262365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.262654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.263778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.265049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.273985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8124b13faa418583b1bf26bcf3956b, user_id=18754deb5aa942f9873edb3bb4e82747, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.277478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 791/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.278306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.278430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.291542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd001f-58ba-4687-b481-295e1f42fc74 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.294231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 806/1597] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/8f8124b13faa418583b1bf26bcf3956b/users/18754deb5aa942f9873edb3bb4e82747/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.297100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.367865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.368765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.369115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.369460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.370223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.372151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.374316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8741b-4ba5-4467-b254-35ccfc8a169d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.379464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.380352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.380696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.381030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.381873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.383550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.388273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 792/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.388273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.398280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 807/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:20.398641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390566-e39f-415f-90a8-2228a90b023e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.399949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.403999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.404739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.405078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.405411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] PATH_INFO: `/v3/projects/91b3bd060c284d38b7e33e259f18e990/users/35ab2cac840248d5ad28e7e572b4b3bb/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.412132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11d28-061e-4443-b74b-a58ce7777f0c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.418355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.418556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.418827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.419121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] PATH_INFO: `/v3/projects/28589a8ce15b496c94589afc096980b9/users/65c5ca5c48ce43d380810428f028ef92/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.428303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b3bd060c284d38b7e33e259f18e990, user_id=35ab2cac840248d5ad28e7e572b4b3bb, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.432669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.436830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28589a8ce15b496c94589afc096980b9, user_id=65c5ca5c48ce43d380810428f028ef92, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.439859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.455555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 793/1600] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/91b3bd060c284d38b7e33e259f18e990/users/35ab2cac840248d5ad28e7e572b4b3bb/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.456622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.457968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 808/1601] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/28589a8ce15b496c94589afc096980b9/users/65c5ca5c48ce43d380810428f028ef92/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.459023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.485889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:20.541841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd315c0-abca-457e-a71b-ca33e594b857 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.547068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337dc39-7066-4806-b045-c04667e06f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.547695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337dc39-7066-4806-b045-c04667e06f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.547942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337dc39-7066-4806-b045-c04667e06f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.548263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337dc39-7066-4806-b045-c04667e06f32 admin admin] PATH_INFO: `/v3/projects/a2bd19c620054cfa85530fdf1ae52b5a/users/c444d49243af4f2994bdc510e59dbe5b/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.557681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05cf64-d93b-4f5b-90ed-64c226972fe8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.562556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.563228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.563526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.563788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] PATH_INFO: `/v3/projects/22868c9a79c94eb29544b9209a0f1ba7/users/558cee9d30a443ceab3c6707255f429e/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.565233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337dc39-7066-4806-b045-c04667e06f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bd19c620054cfa85530fdf1ae52b5a, user_id=c444d49243af4f2994bdc510e59dbe5b, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.568165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337dc39-7066-4806-b045-c04667e06f32 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.580640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22868c9a79c94eb29544b9209a0f1ba7, user_id=558cee9d30a443ceab3c6707255f429e, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.582552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 809/1602] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/a2bd19c620054cfa85530fdf1ae52b5a/users/c444d49243af4f2994bdc510e59dbe5b/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.583584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.584143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.584433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.584709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.601515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 794/1603] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/22868c9a79c94eb29544b9209a0f1ba7/users/558cee9d30a443ceab3c6707255f429e/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.602345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.610288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:20.620347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] MFA Rules not processed for user `18754deb5aa942f9873edb3bb4e82747`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:20.622123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:20.675717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab4d7a-6727-47ac-a165-eb2792b06da7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.681415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235263-0619-48b9-8965-77a3f42468fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.682168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235263-0619-48b9-8965-77a3f42468fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.682512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235263-0619-48b9-8965-77a3f42468fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.682856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235263-0619-48b9-8965-77a3f42468fa admin admin] PATH_INFO: `/v3/projects/50b4e3dccbea4d298c769fe999e30d8b/users/9ce6fbb5e7264feb816242192bcbf900/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.694699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 810/1604] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:20.695616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:20.703044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17235263-0619-48b9-8965-77a3f42468fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b4e3dccbea4d298c769fe999e30d8b, user_id=9ce6fbb5e7264feb816242192bcbf900, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.705840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17235263-0619-48b9-8965-77a3f42468fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.707331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04aa47-80bd-4a5a-92db-24c67cb95cc2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:20.712932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07878ec-6673-4b12-96c4-dd71c9637887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:20.713602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07878ec-6673-4b12-96c4-dd71c9637887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.713911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07878ec-6673-4b12-96c4-dd71c9637887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.714201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07878ec-6673-4b12-96c4-dd71c9637887 admin admin] PATH_INFO: `/v3/projects/d6ea6b54ec784e82b86c7ba2649bcb61/users/beaa61185a6144b3b9c7db1a378c46b0/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.731103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 795/1605] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/50b4e3dccbea4d298c769fe999e30d8b/users/9ce6fbb5e7264feb816242192bcbf900/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.731103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902899-a7b7-44a9-969e-66d645ff611b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.731103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902899-a7b7-44a9-969e-66d645ff611b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.731103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902899-a7b7-44a9-969e-66d645ff611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.741925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07878ec-6673-4b12-96c4-dd71c9637887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ea6b54ec784e82b86c7ba2649bcb61, user_id=beaa61185a6144b3b9c7db1a378c46b0, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:20.744012 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07878ec-6673-4b12-96c4-dd71c9637887 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:20.763671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f6902899-a7b7-44a9-969e-66d645ff611b None None] MFA Rules not processed for user `35ab2cac840248d5ad28e7e572b4b3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:20.764376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 811/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:20 2022] PUT /identity/v3/projects/d6ea6b54ec784e82b86c7ba2649bcb61/users/beaa61185a6144b3b9c7db1a378c46b0/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:20.765092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f6902899-a7b7-44a9-969e-66d645ff611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:20.769668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049001-223c-41c3-8653-7b288fd3cdab None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.770025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049001-223c-41c3-8653-7b288fd3cdab None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.770301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049001-223c-41c3-8653-7b288fd3cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.809603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7a049001-223c-41c3-8653-7b288fd3cdab None None] MFA Rules not processed for user `65c5ca5c48ce43d380810428f028ef92`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:20.810835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7a049001-223c-41c3-8653-7b288fd3cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:20.860325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 796/1607] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:20.862725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.862725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.862993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.872486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:20.888695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:20.890345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:20.945149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 812/1608] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:20.947277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b927-6252-4c95-a488-aabfce11e6c6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:20.947572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b927-6252-4c95-a488-aabfce11e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:20.947849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b927-6252-4c95-a488-aabfce11e6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:20.977515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3995b927-6252-4c95-a488-aabfce11e6c6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:20.979455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3995b927-6252-4c95-a488-aabfce11e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:20.993101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 797/1609] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:20.994572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.012891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fd908-bd72-46b6-bb10-06eefacee678 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.019424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92655a0-cb69-4ad3-bca2-df9313405a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.020285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92655a0-cb69-4ad3-bca2-df9313405a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.021019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92655a0-cb69-4ad3-bca2-df9313405a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.021460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92655a0-cb69-4ad3-bca2-df9313405a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.022368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92655a0-cb69-4ad3-bca2-df9313405a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.026366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92655a0-cb69-4ad3-bca2-df9313405a96 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.064051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 798/1610] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:21.069715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942114-ada6-4339-abba-7da9fb77ae9c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.070115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942114-ada6-4339-abba-7da9fb77ae9c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.070495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942114-ada6-4339-abba-7da9fb77ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.071023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 813/1611] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:21.073122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.074130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.074432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.089816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:21.096187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ca942114-ada6-4339-abba-7da9fb77ae9c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:21.097405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:21.097805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ca942114-ada6-4339-abba-7da9fb77ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:21.099100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:21.182029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 799/1612] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:21.183330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fe4b5-4965-467b-ba3a-242ba0bff2f8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.183623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fe4b5-4965-467b-ba3a-242ba0bff2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.183898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fe4b5-4965-467b-ba3a-242ba0bff2f8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.188024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 814/1613] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:21.189036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.193514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 800/1614] 10.222.0.23 () {54 vars in 962 bytes} [Wed Aug 17 14:20:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:21.194458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fe4b5-4965-467b-ba3a-242ba0bff2f8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.202483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115ef1-cf79-4b78-addb-5b602616b000 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.208893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.209671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.210059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.210438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.211178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.214313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.260384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 815/1615] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:21 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:21.262413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.281022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fe4b5-4965-467b-ba3a-242ba0bff2f8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.324767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:21.345101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.345716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.346094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.346565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.350280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0821-4ca4-476e-9f3b-77454117441e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.356640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1519446-952f-4487-8c2a-ee8827d84df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.357793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519446-952f-4487-8c2a-ee8827d84df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.358230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519446-952f-4487-8c2a-ee8827d84df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.358676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519446-952f-4487-8c2a-ee8827d84df0 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.359499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1519446-952f-4487-8c2a-ee8827d84df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.359836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.361405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.362423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1519446-952f-4487-8c2a-ee8827d84df0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.373844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 801/1616] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:21.375049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.384074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea921d-bc2d-4549-ba07-bdbab5ad3ae8 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.388288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.389028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.389862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.390271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.394282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 816/1617] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:21 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:21.395881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.396414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.397353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.410308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.414062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.448593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 802/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:21.449868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.456579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:21.458793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177c8de-b804-4bbe-af66-ebaf38618e95 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.460945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:21.470804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.471539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.472322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.472894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.497601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.501553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.523149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 803/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:21.526233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.532830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:21.547027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55891e-dc72-4bf8-9865-a3557c9921ec service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.560948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 817/1620] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 17 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:21.561973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.562554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.563203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.563485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.563755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.574933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272662a-f57a-455b-ab07-6728ea457506 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.581307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.582223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.582626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.583247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.583943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.584965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.586485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.586653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.613255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 804/1621] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:21.614216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.619089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 818/1622] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:21 2022] POST /identity/v3/users => generated 299 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:21.620312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.634461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbdc7a-ad99-4523-9d52-47a112256520 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.639158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176dfcc-c7ac-41e6-8508-0ccb32d49f37 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.650707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.651578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.652349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.652772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.655323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.656071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.656463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.656740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.659140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.662112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.693289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 805/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:21.693289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.714515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708dd76-290f-4029-9a0f-30f452f7f504 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.726897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.729352 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.729658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.730543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.731996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.736155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.745352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.747521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.765609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 819/1624] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:21.767828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.778554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 806/1625] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:21.782798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.791595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b54f-f004-4c39-a9fc-3e5ae3793033 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.798721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.799397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.799676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.800125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] PATH_INFO: `/v3/projects/71b19058d101411bad60be948c0ce09d/users/8823169dc4eb4f1bb30c9d15afedd822/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.804468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f7078-e1ff-45ab-a838-a957f521d9cb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:21.816964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:21.817720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:21.818006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:21.818282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] PATH_INFO: `/v3/projects/0c0bc040c258486889b85d9135640468/users/5be3e08ffe7e4df6866373b5865644c7/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:21.822598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b19058d101411bad60be948c0ce09d, user_id=8823169dc4eb4f1bb30c9d15afedd822, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.825613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.843058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 820/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:21 2022] PUT /identity/v3/projects/71b19058d101411bad60be948c0ce09d/users/8823169dc4eb4f1bb30c9d15afedd822/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:21.847223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.861601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0bc040c258486889b85d9135640468, user_id=5be3e08ffe7e4df6866373b5865644c7, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:21.864483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:21.891896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 807/1627] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:21 2022] PUT /identity/v3/projects/0c0bc040c258486889b85d9135640468/users/5be3e08ffe7e4df6866373b5865644c7/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:21.896133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:21.988449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9882-1526-4ea6-9438-836c5d193d70 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:22.071044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1412d49-25e0-4785-a8e7-257eb7f4b3e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:22.074992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:22.074992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.079257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.079257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.079257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:22.080229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:22.103610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 808/1628] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:20:22.107514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:22.128007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9c09-8123-4ad3-b57c-92f09807accf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:22.129917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:22.138171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efd8f-73b6-4a6b-97fa-fec80cdfea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:22.138416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:22.139064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.139187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efd8f-73b6-4a6b-97fa-fec80cdfea6a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.139387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.139651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] PATH_INFO: `/v3/projects/0c0bc040c258486889b85d9135640468/users/5be3e08ffe7e4df6866373b5865644c7/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.140225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efd8f-73b6-4a6b-97fa-fec80cdfea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.141339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efd8f-73b6-4a6b-97fa-fec80cdfea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.143817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0bc040c258486889b85d9135640468, user_id=5be3e08ffe7e4df6866373b5865644c7, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:22.144751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477efd8f-73b6-4a6b-97fa-fec80cdfea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:22.146372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477efd8f-73b6-4a6b-97fa-fec80cdfea6a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:22.147140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:22.189223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 809/1630] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:22 2022] PUT /identity/v3/projects/0c0bc040c258486889b85d9135640468/users/5be3e08ffe7e4df6866373b5865644c7/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:22.196045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 821/1630] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:20:22.202303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:22.202764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.203180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.203467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.278227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:22.308538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b562b-fc1c-4771-8ad2-7afb27d7a369 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:22.311587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] MFA Rules not processed for user `5be3e08ffe7e4df6866373b5865644c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:22.318408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30624772-012f-4aed-931b-4bce05ffe131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:22.319159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30624772-012f-4aed-931b-4bce05ffe131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.319493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30624772-012f-4aed-931b-4bce05ffe131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.319772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30624772-012f-4aed-931b-4bce05ffe131 admin admin] PATH_INFO: `/v3/projects/71b19058d101411bad60be948c0ce09d/users/8823169dc4eb4f1bb30c9d15afedd822/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.320800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:22.322406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30624772-012f-4aed-931b-4bce05ffe131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b19058d101411bad60be948c0ce09d, user_id=8823169dc4eb4f1bb30c9d15afedd822, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:22.325497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30624772-012f-4aed-931b-4bce05ffe131 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:22.350262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 810/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:22 2022] PUT /identity/v3/projects/71b19058d101411bad60be948c0ce09d/users/8823169dc4eb4f1bb30c9d15afedd822/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:22.351976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811152-509b-45ed-9789-c420e0bbac3f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.352348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811152-509b-45ed-9789-c420e0bbac3f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.352664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811152-509b-45ed-9789-c420e0bbac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.396638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-43811152-509b-45ed-9789-c420e0bbac3f None None] MFA Rules not processed for user `8823169dc4eb4f1bb30c9d15afedd822`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:22.397897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-43811152-509b-45ed-9789-c420e0bbac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:22.464326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 822/1632] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:22.477030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:22.572103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709139cd-9591-4858-8cc2-7ae4d94ffc5c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:22.592257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 811/1633] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:22.608814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30775-69ea-4b10-8354-c5aa14707fc2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.609097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30775-69ea-4b10-8354-c5aa14707fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.609376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30775-69ea-4b10-8354-c5aa14707fc2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.612293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 812/1634] 10.222.0.23 () {54 vars in 962 bytes} [Wed Aug 17 14:20:22 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:22.613083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30775-69ea-4b10-8354-c5aa14707fc2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:22.654628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b753ca-efd6-4f7b-9b99-d2a230c2e9c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:22.655822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b753ca-efd6-4f7b-9b99-d2a230c2e9c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.663345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b753ca-efd6-4f7b-9b99-d2a230c2e9c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.663902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b753ca-efd6-4f7b-9b99-d2a230c2e9c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.705488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30775-69ea-4b10-8354-c5aa14707fc2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:22.710158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cc7cc-6fdd-4dd9-bb3e-efee7cefa4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:22.710892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cc7cc-6fdd-4dd9-bb3e-efee7cefa4ca service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.711247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cc7cc-6fdd-4dd9-bb3e-efee7cefa4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.711599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cc7cc-6fdd-4dd9-bb3e-efee7cefa4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.731793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cc7cc-6fdd-4dd9-bb3e-efee7cefa4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:22.734458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cc7cc-6fdd-4dd9-bb3e-efee7cefa4ca service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:22.748870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 813/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:22.751995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:22.752297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:22.752570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:22.787087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:22.803127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:22.804413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:22.815162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b753ca-efd6-4f7b-9b99-d2a230c2e9c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:22.817267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b753ca-efd6-4f7b-9b99-d2a230c2e9c1 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:22.846212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 823/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:22.955901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:23.004076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 814/1637] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 17 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:23.011660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c83a4a-20ac-400d-bb11-51b55ff5defa None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.011660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c83a4a-20ac-400d-bb11-51b55ff5defa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.011660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c83a4a-20ac-400d-bb11-51b55ff5defa None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.013291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 824/1638] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 17 14:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:23.019612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:23.027183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.027483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.027749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.034778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abffb5-25aa-4f62-80d7-ee482cac6bb4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:23.039281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:23.040573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.041096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.041575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.065008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:23.070054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:23.084114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 825/1639] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:23.085112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:23.206428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:23.208978 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:23.263041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 815/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:23.264049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:23.273417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f757de5-a8ba-43c2-bbf3-1ec9d5a07ff4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:23.293974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:23.294645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.295327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.295327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] PATH_INFO: `/v3/users/65c5ca5c48ce43d380810428f028ef92` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.301633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05574e-4bd1-40be-99ea-a90788c3ebde service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:23.312240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c5ca5c48ce43d380810428f028ef92)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:23.314503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:20:23.314503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 17 14:20:23.314503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: Aug 17 14:20:23.319345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:23.326393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf989e-d4c6-4842-9523-5f3e51e16d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:23.327036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf989e-d4c6-4842-9523-5f3e51e16d32 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.327312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf989e-d4c6-4842-9523-5f3e51e16d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.333701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf989e-d4c6-4842-9523-5f3e51e16d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.371787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf989e-d4c6-4842-9523-5f3e51e16d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:23.373393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf989e-d4c6-4842-9523-5f3e51e16d32 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:23.405753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 816/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:23.460739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c5ca5c48ce43d380810428f028ef92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:23.490211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c5ca5c48ce43d380810428f028ef92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:23.491027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c5ca5c48ce43d380810428f028ef92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:23.541130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c5ca5c48ce43d380810428f028ef92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:23.556958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-caf7abd4-ace5-4bbd-93f9-8c4340b0908d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c5ca5c48ce43d380810428f028ef92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:23.570613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.570613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.570613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.572116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 826/1642] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:23 2022] DELETE /identity/v3/users/65c5ca5c48ce43d380810428f028ef92 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:23.606967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:23.606967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:23.640832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cd87c-7147-4849-b92a-c3faaee9ed90 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.641503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cd87c-7147-4849-b92a-c3faaee9ed90 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.642001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cd87c-7147-4849-b92a-c3faaee9ed90 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.643833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 827/1643] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 17 14:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:20:23.649758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.650372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.650856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.673243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:23.675183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:23.742211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:23.758436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 817/1644] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:23.780682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 828/1645] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:23.788626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:23.790802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:23.862051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90471c8-6c5f-4715-9e3d-0134f681b2c4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:23.866108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:23.866770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:23.867050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:23.867320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:23.884848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:23.886322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:23.911072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 818/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:23.937250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:23.938941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:24.048311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6200-f44f-4bfd-8ba2-584819151597 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:24.052588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182388-4626-4482-86f1-f7f298990fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:24.053579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182388-4626-4482-86f1-f7f298990fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:24.054285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182388-4626-4482-86f1-f7f298990fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:24.054794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182388-4626-4482-86f1-f7f298990fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:24.083514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10182388-4626-4482-86f1-f7f298990fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:24.085796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10182388-4626-4482-86f1-f7f298990fc6 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:24.095838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:24.097725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:24.107582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 829/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:24.119531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5394b-59a0-4e54-b754-3a000e65539a service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:24.129103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:24.130214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:24.130704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:24.131245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] PATH_INFO: `/v3/users/35ab2cac840248d5ad28e7e572b4b3bb` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:24.134275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ab2cac840248d5ad28e7e572b4b3bb)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:24.137680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:24.161333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:24.223873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ab2cac840248d5ad28e7e572b4b3bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:24.225855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ab2cac840248d5ad28e7e572b4b3bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:24.226766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ab2cac840248d5ad28e7e572b4b3bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:24.253557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ab2cac840248d5ad28e7e572b4b3bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:24.263973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ab2cac840248d5ad28e7e572b4b3bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:24.292239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 819/1648] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:24 2022] DELETE /identity/v3/users/35ab2cac840248d5ad28e7e572b4b3bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:24.296659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a134-2466-48a0-8f86-d70fd7884cfa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:24.297464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a134-2466-48a0-8f86-d70fd7884cfa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:24.297822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a134-2466-48a0-8f86-d70fd7884cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:24.325201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1575a134-2466-48a0-8f86-d70fd7884cfa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:24.327633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1575a134-2466-48a0-8f86-d70fd7884cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:24.478887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 830/1649] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:24.512494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:24.514136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:24.699632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2fc7-6630-4241-b926-42f490c4efb9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:24.704224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:24.705669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:24.705966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:24.706384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:24.718674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:24.720501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:24.742284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 820/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:24.905976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:24.906710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:24.906710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:24.966310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] MFA Rules not processed for user `558cee9d30a443ceab3c6707255f429e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:24.967595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:25.062735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 831/1651] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:25.066528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:25.068280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:25.093646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788473-3d7f-4cac-9b2f-1888499d4ca7 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:25.106675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:25.107884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:25.108221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:25.108501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:25.109147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:25.111150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:25.180140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 821/1652] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:25 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:25.185141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:25.232168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621e78d-b2f4-43ff-bde7-bab25439665d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:25.246998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:25.342078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:25.342728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:25.343022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:25.343288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:25.343931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:25.345929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:25.386475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 832/1653] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:25 2022] POST /identity/v3/users => generated 309 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:25.387478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:25.402723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddf4ad-c1a0-48c3-9637-d63494664344 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:25.419895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:25.419895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:25.420206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:25.420421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:25.421048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:25.422941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:25.445128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 822/1654] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:25.449375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:25.462443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ab510-eaeb-43f0-9384-1414d404ceb4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:25.476292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:25.477097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:25.477923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:25.478203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] PATH_INFO: `/v3/projects/2fd1c618b5f641b3b8db1259e88a94c1/users/b0256c8fcfe747128611b7ad90fd4628/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:25.513217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd1c618b5f641b3b8db1259e88a94c1, user_id=b0256c8fcfe747128611b7ad90fd4628, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:25.515988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:25.545903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 833/1655] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:25 2022] PUT /identity/v3/projects/2fd1c618b5f641b3b8db1259e88a94c1/users/b0256c8fcfe747128611b7ad90fd4628/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:25.547335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:25.564590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173cb0a-7770-4a69-a089-6c5b25d28f87 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:25.681302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:25.682072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:25.682355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:25.683184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:25.683447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:25.685140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:25.687745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:25.708383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 823/1656] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:25.712614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:25.732693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962908-df9a-4a45-922e-51c5f6e7a903 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:25.751639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:25.752375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:25.752652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:25.752926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] PATH_INFO: `/v3/projects/2fd1c618b5f641b3b8db1259e88a94c1/users/b0256c8fcfe747128611b7ad90fd4628/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:25.756231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd1c618b5f641b3b8db1259e88a94c1, user_id=b0256c8fcfe747128611b7ad90fd4628, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:25.759041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:25.802932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 834/1657] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:25 2022] PUT /identity/v3/projects/2fd1c618b5f641b3b8db1259e88a94c1/users/b0256c8fcfe747128611b7ad90fd4628/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:26.222576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:26.224581 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:26.245529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f72ea1-c030-4e7a-a107-cfe75185f2b8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:26.336254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:26.337773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:26.338282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:26.338863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] PATH_INFO: `/v3/projects/28589a8ce15b496c94589afc096980b9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:26.341368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28589a8ce15b496c94589afc096980b9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:26.350524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:20:26.350524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 17 14:20:26.350524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: Aug 17 14:20:26.353766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:26.441290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28589a8ce15b496c94589afc096980b9', 'request_id': 'req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.451526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28589a8ce15b496c94589afc096980b9', 'request_id': 'req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.466109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28589a8ce15b496c94589afc096980b9', 'request_id': 'req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.489985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] The token cache is being invalidate because project 28589a8ce15b496c94589afc096980b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:26.490484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.492580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.497260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 824/1658] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:26 2022] DELETE /identity/v3/projects/28589a8ce15b496c94589afc096980b9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:26.498725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:26.500585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:26.523401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b31c3-a583-4c27-8687-afaba9d0cb1d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:26.658054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:26.658878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:26.658989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:26.659274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] PATH_INFO: `/v3/users/5be3e08ffe7e4df6866373b5865644c7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:26.669004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be3e08ffe7e4df6866373b5865644c7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:26.670902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:26.756943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be3e08ffe7e4df6866373b5865644c7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.766195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be3e08ffe7e4df6866373b5865644c7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.766856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be3e08ffe7e4df6866373b5865644c7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.784946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be3e08ffe7e4df6866373b5865644c7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.788220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:26.797418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-439f709a-05b2-4ee1-a4e0-ddf610f5fbc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be3e08ffe7e4df6866373b5865644c7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:26.811320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 835/1659] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:26 2022] DELETE /identity/v3/users/5be3e08ffe7e4df6866373b5865644c7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:27.208330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:27.210388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:27.248537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b0ffb-b44e-4d43-a1d0-c0ece27cce10 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:27.394564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:27.395736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:27.396241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:27.396717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] PATH_INFO: `/v3/projects/91b3bd060c284d38b7e33e259f18e990` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:27.401829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b3bd060c284d38b7e33e259f18e990)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:27.404311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:27.475927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:27.510331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b3bd060c284d38b7e33e259f18e990', 'request_id': 'req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:27.526179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b3bd060c284d38b7e33e259f18e990', 'request_id': 'req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:27.547096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b3bd060c284d38b7e33e259f18e990', 'request_id': 'req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:27.570426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] The token cache is being invalidate because project 91b3bd060c284d38b7e33e259f18e990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:27.572064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:27.573153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a436a4-7d40-4c0b-ae0b-ec47f336fe30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:27.576645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 825/1660] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:27 2022] DELETE /identity/v3/projects/91b3bd060c284d38b7e33e259f18e990 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:27.581324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:27.581803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:27.581882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:27.621126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:27.622371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:27.793069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:27.793069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:27.793069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:27.805296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 836/1661] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:27.827132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:27.830804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:27.884106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 826/1662] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:27.887722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:27.907380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412917e-fc68-42c1-b014-d746a1e78c5b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:27.916200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:27.917073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:27.917532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:27.917975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:27.918798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:27.919433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:27.922834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283959c-08c0-4a0e-9e4b-4ef426c6589f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:27.943689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 837/1663] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:27.949021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:27.961453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d59a-c614-4d1b-a7de-44038c6545fa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:27.973316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:27.973963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:27.974324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:27.974511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:27.975722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:27.978876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:28.021083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.021377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.021659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.032260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 827/1664] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:27 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:28.034998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:28.071559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] MFA Rules not processed for user `b5872d0410214dd6b44c36c7952a5ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:28.075526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:28.236170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3921fb-11b8-46ba-9b21-17f07a5f583b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:28.251833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 838/1665] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:28.263222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:28.265235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:28.266315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:28.266937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.267223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.267501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.270584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:28.273131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:28.324649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 828/1666] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:28 2022] POST /identity/v3/users => generated 303 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:28.326526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:28.344108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36fb0-da85-46c5-ace6-e5c18a909a7b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:28.351094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:28.352204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.353218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.353756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.354796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:28.357384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:28.378147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 829/1667] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:28.379529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:28.394892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa431e55-1173-449c-afca-711d022496b3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:28.402371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:28.403437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.403924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.404439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.405862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:28.413006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:28.438797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 830/1668] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:28.444674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:28.480247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76db0a1-814f-4830-ba26-9b0428cce44a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:28.492081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666bbbb-9bd6-4606-ad0b-bc7b00484861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:28.492584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666bbbb-9bd6-4606-ad0b-bc7b00484861 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.492930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666bbbb-9bd6-4606-ad0b-bc7b00484861 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.493602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666bbbb-9bd6-4606-ad0b-bc7b00484861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.499507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64705f1-cb00-45b7-a788-e4cc6a0a7870 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:28.500488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:28.506718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:28.507531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.507869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.508183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] PATH_INFO: `/v3/projects/51017d3b1c5840a2b7067c7680cf48e1/users/f0735cc6c6ac4217984e9cecbe6df241/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.509250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666bbbb-9bd6-4606-ad0b-bc7b00484861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:28.510688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666bbbb-9bd6-4606-ad0b-bc7b00484861 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:28.541307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51017d3b1c5840a2b7067c7680cf48e1, user_id=f0735cc6c6ac4217984e9cecbe6df241, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:28.543652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 839/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:20:28.560313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:28.601590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 831/1670] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:28 2022] PUT /identity/v3/projects/51017d3b1c5840a2b7067c7680cf48e1/users/f0735cc6c6ac4217984e9cecbe6df241/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:28.613900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc18ac4-e21b-4973-b635-c17eb3a4bd28 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:28.614921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc18ac4-e21b-4973-b635-c17eb3a4bd28 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:28.614921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc18ac4-e21b-4973-b635-c17eb3a4bd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:28.701416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9bc18ac4-e21b-4973-b635-c17eb3a4bd28 None None] MFA Rules not processed for user `f0735cc6c6ac4217984e9cecbe6df241`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:28.702675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9bc18ac4-e21b-4973-b635-c17eb3a4bd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:28.905782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:28.906691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 840/1671] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:29.065766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:29.150622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2712603-2fb2-4c29-b757-f994626b9232 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:29.158192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.158471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.163428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.181728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:29.182375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.182712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.184328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.184980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:29.187016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:29.219250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] MFA Rules not processed for user `b0256c8fcfe747128611b7ad90fd4628`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:29.220630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:29.280129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 832/1672] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:28 2022] POST /identity/v3/projects => generated 405 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:29.284100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:29.379294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 841/1673] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:29.436732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec954b8d-a853-4e2c-889a-de3b8662c029 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:29.444851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:29.446393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.446830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.447258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.448090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:29.450835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:29.509717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 833/1674] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:29 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:29.513978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:29.535753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e1d66-408f-424b-9763-467e86bf5f6b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:29.570131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:29.570819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.577732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:29.583713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:29.585766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.586063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.587322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:29.596674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:29.601476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82acc8d-ca6d-4be9-90a8-10e0996fbec0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:29.608425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:29.609182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.609527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.610473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] PATH_INFO: `/v3/projects/0c0bc040c258486889b85d9135640468` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.611334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0bc040c258486889b85d9135640468)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:29.615888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:29.662246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 842/1675] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:29.663324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:29.722233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43102bb-d43d-41c4-801e-951c638be95c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:29.755679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0bc040c258486889b85d9135640468', 'request_id': 'req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:29.792962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0bc040c258486889b85d9135640468', 'request_id': 'req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:29.809079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0bc040c258486889b85d9135640468', 'request_id': 'req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:29.855795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] The token cache is being invalidate because project 0c0bc040c258486889b85d9135640468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:29.860729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:29.861565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4bae9d53-aa79-4b95-a372-1db1ae9ccde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:29.874457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 834/1676] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:29 2022] DELETE /identity/v3/projects/0c0bc040c258486889b85d9135640468 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:29.886578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192ba7-adb5-41b7-9d0a-1a73e13e1a53 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.886988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192ba7-adb5-41b7-9d0a-1a73e13e1a53 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.887281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192ba7-adb5-41b7-9d0a-1a73e13e1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.926734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:29.927823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:29.928545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:29.929069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] PATH_INFO: `/v3/projects/823296ba64424a31bb3c2d09bf0cc48a/users/0d8071955d064594beaea5e67a503f73/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:29.933964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:29.953682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=823296ba64424a31bb3c2d09bf0cc48a, user_id=0d8071955d064594beaea5e67a503f73, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:29.957437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:29.973281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-66192ba7-adb5-41b7-9d0a-1a73e13e1a53 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:29.980224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-66192ba7-adb5-41b7-9d0a-1a73e13e1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:30.009111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 843/1677] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:29 2022] PUT /identity/v3/projects/823296ba64424a31bb3c2d09bf0cc48a/users/0d8071955d064594beaea5e67a503f73/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:30.013146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.019395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:30.092822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:30.217416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 835/1678] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:30.219272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.219588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.219931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.251081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448bf28-90d5-471b-af16-5f5b960ec81f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.263903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.266988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.267277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.267547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.268249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:30.273156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:30.277306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:30.278318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:30.309098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 836/1679] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:30.310171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 844/1680] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:30.311705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.312918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.339400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f8744-1a65-474a-b34d-3b2e63c9477e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.342700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194316a5-6d80-44f0-be6f-575386b27e96 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.356842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.357539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.357654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.363472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.366501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:30.367260 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:30.369417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b9e2-9dec-40c4-9b5d-ae2155a9f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.370123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b9e2-9dec-40c4-9b5d-ae2155a9f4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.370408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b9e2-9dec-40c4-9b5d-ae2155a9f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.370686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b9e2-9dec-40c4-9b5d-ae2155a9f4ce admin admin] PATH_INFO: `/v3/projects/823296ba64424a31bb3c2d09bf0cc48a/users/0d8071955d064594beaea5e67a503f73/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.375519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:30.386676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b9e2-9dec-40c4-9b5d-ae2155a9f4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=823296ba64424a31bb3c2d09bf0cc48a, user_id=0d8071955d064594beaea5e67a503f73, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:30.400712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b9e2-9dec-40c4-9b5d-ae2155a9f4ce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:30.429852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 837/1681] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:30.440294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.451198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 845/1682] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:30 2022] PUT /identity/v3/projects/823296ba64424a31bb3c2d09bf0cc48a/users/0d8071955d064594beaea5e67a503f73/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:30.464345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.464626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.464910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.467085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106e0c9-ed2c-44cf-9241-02ccffa504c2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.537420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] MFA Rules not processed for user `0d8071955d064594beaea5e67a503f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:30.541931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:30.638931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.642894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.643354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.643743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.644699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:30.649724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:30.732944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 838/1683] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:30 2022] POST /identity/v3/projects => generated 401 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:30.733345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.766045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 846/1684] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:30.788808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.792100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:30.890011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719a78-4431-4ba7-af52-407237e093cd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.897137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.897879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.898273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.898634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.899349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:30.901718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:30.910499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd85763-ecd6-4785-94c5-6c8514cb19b1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.915435 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:30.950187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 839/1685] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:30 2022] POST /identity/v3/users => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:30.954729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:30.981407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4e525-b994-48df-b337-15b454352009 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:30.993474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42276939-a07f-4c53-9f7a-f7c1ee3bee1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.994486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276939-a07f-4c53-9f7a-f7c1ee3bee1d service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.994891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276939-a07f-4c53-9f7a-f7c1ee3bee1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.995254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276939-a07f-4c53-9f7a-f7c1ee3bee1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:30.995429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:30.997153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:30.998745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:30.999824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.000312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:31.004135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:31.034431 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 840/1686] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:31.037713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:31.068998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8461ea-8348-4209-85a0-b29009303ca1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:31.085641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:31.086315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:31.090506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:31.090854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.092608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:31.097095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:31.134972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 841/1687] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:31.139257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:31.148446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42276939-a07f-4c53-9f7a-f7c1ee3bee1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:31.152916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42276939-a07f-4c53-9f7a-f7c1ee3bee1d service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:31.155773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:31.169248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2807-2f3f-4651-a96a-65ea6cef0135 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:31.178875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 847/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:30 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:31.200418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:31.205309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:31.205309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:31.210308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] PATH_INFO: `/v3/projects/0df1facd759b442e88b9d5a09939885c/users/28eb24deb331468fbf310d7e4c5e50f1/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.281820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df1facd759b442e88b9d5a09939885c, user_id=28eb24deb331468fbf310d7e4c5e50f1, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:31.291082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:31.348784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:31.349050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:31.349140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 842/1689] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:31 2022] PUT /identity/v3/projects/0df1facd759b442e88b9d5a09939885c/users/28eb24deb331468fbf310d7e4c5e50f1/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:31.349614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.425636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] MFA Rules not processed for user `28eb24deb331468fbf310d7e4c5e50f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:31.426809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:31.463808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:31.628236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 848/1690] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:31.629856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a884-76b5-4b0b-8135-1b3e24f07e26 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:31.632312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:31.646036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92878b-bb0f-4046-8887-9a383a30208c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:31.649449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:31.651576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:31.652489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:31.652868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] PATH_INFO: `/v3/users/f0735cc6c6ac4217984e9cecbe6df241` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.655781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0735cc6c6ac4217984e9cecbe6df241)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:31.656630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:31.658685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:31.659384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:31.659702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:31.660174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.662644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:31.665720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:31.719477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 849/1691] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:31 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:31.744888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:31.802501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0735cc6c6ac4217984e9cecbe6df241'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:31.804364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0735cc6c6ac4217984e9cecbe6df241'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:31.806327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0735cc6c6ac4217984e9cecbe6df241'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:31.815873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:31.844526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0735cc6c6ac4217984e9cecbe6df241'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:31.869122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b957ba78-0fd3-4c89-b38c-01044e458250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0735cc6c6ac4217984e9cecbe6df241'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:31.907178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 843/1692] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:31 2022] DELETE /identity/v3/users/f0735cc6c6ac4217984e9cecbe6df241 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:31.909857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:31.910206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:31.910539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:31.918611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4143124-dc95-4384-a4ca-e09c71582be6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:31.963508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:31.965388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:32.054543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:32.074967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 844/1693] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:32.133587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.134230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.134618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.134792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.135405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.137384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.181409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 850/1694] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:31 2022] POST /identity/v3/users => generated 306 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:32.182912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.184562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:32.213004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.214967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:32.216330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ef6f-dac1-4d48-be6e-1d418b885e93 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:32.230567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.233278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.233811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.234289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.235754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.240582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.293692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 845/1695] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:32.297403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.338742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ff228-006f-4236-8c82-9f76bfa3e6ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:32.354372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbed8d-0e04-4220-ac6b-74e167952d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.357558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbed8d-0e04-4220-ac6b-74e167952d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.358815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbed8d-0e04-4220-ac6b-74e167952d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.359862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbed8d-0e04-4220-ac6b-74e167952d2f admin admin] PATH_INFO: `/v3/projects/2c81a651d213469f9ff1be5dfafe0d57/users/8ab2195ef97448e38907801d58ea4693/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.371547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdaf4f-ccf4-4e03-bcf5-cdccf9025e94 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:32.379479 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7c407-ba12-4ee3-88c5-7c81a9aaeb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.380159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c407-ba12-4ee3-88c5-7c81a9aaeb00 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.380506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c407-ba12-4ee3-88c5-7c81a9aaeb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.380689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c407-ba12-4ee3-88c5-7c81a9aaeb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.398063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7c407-ba12-4ee3-88c5-7c81a9aaeb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.400161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7c407-ba12-4ee3-88c5-7c81a9aaeb00 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.410407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbed8d-0e04-4220-ac6b-74e167952d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c81a651d213469f9ff1be5dfafe0d57, user_id=8ab2195ef97448e38907801d58ea4693, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.413932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 851/1696] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:32.416009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd1c6-5031-4f85-93c1-5933cc4113b0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.416632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd1c6-5031-4f85-93c1-5933cc4113b0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.416958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd1c6-5031-4f85-93c1-5933cc4113b0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.419331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 852/1697] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:32.421213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbed8d-0e04-4220-ac6b-74e167952d2f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.449865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 846/1698] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:32 2022] PUT /identity/v3/projects/2c81a651d213469f9ff1be5dfafe0d57/users/8ab2195ef97448e38907801d58ea4693/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:32.454246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd1c6-5031-4f85-93c1-5933cc4113b0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.471204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d48c2-e7d3-4856-822a-5731b79c24ba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.472003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d48c2-e7d3-4856-822a-5731b79c24ba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.472891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d48c2-e7d3-4856-822a-5731b79c24ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.522292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-766d48c2-e7d3-4856-822a-5731b79c24ba None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:32.526615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-766d48c2-e7d3-4856-822a-5731b79c24ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:32.630581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd1c6-5031-4f85-93c1-5933cc4113b0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:32.641621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.642460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.645413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.645689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.646381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.651694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.664330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:32.673388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 853/1699] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:32.674680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.682772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 847/1700] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:20:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:32.696674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574c13-2570-4dbe-8f76-9f3a7bde6d97 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:32.699097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231a74-72a0-4231-85f9-869ca3da20c8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.700128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231a74-72a0-4231-85f9-869ca3da20c8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.700416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231a74-72a0-4231-85f9-869ca3da20c8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.703068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 848/1701] 10.222.0.23 () {54 vars in 961 bytes} [Wed Aug 17 14:20:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:32.708513 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.709483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.709773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.719066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e081-faf6-4813-a25d-25ad109f0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.719778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e081-faf6-4813-a25d-25ad109f0b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.721300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e081-faf6-4813-a25d-25ad109f0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.721300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e081-faf6-4813-a25d-25ad109f0b3e admin admin] PATH_INFO: `/v3/projects/2c81a651d213469f9ff1be5dfafe0d57/users/8ab2195ef97448e38907801d58ea4693/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.732744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e081-faf6-4813-a25d-25ad109f0b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c81a651d213469f9ff1be5dfafe0d57, user_id=8ab2195ef97448e38907801d58ea4693, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.734519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e081-faf6-4813-a25d-25ad109f0b3e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.757380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:32.759612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:32.775701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 854/1702] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:32 2022] PUT /identity/v3/projects/2c81a651d213469f9ff1be5dfafe0d57/users/8ab2195ef97448e38907801d58ea4693/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:32.785957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.786276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.786555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.849909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] MFA Rules not processed for user `8ab2195ef97448e38907801d58ea4693`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:32.851275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:32.882736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 849/1703] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Aug 17 14:20:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:32.892160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.919518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4539ca-0641-47d1-9992-0eb29397de61 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:32.926851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:32.927600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:32.927997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:32.928544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:32.943046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:32.944115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:32.971722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 850/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:20:32.980488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 855/1705] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:32.992049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:32.995002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:33.078075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:33.096421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa684c7-3142-4e0d-a350-4d38356b3eb0 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:33.116115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:33.116973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:33.119729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:33.120121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:33.133765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:33.135790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:33.153234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 851/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:33.281264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:33.299056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da8e7-631d-4360-9501-b4be543e78bc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:33.303252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:33.303998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:33.304278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:33.304553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:33.312826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:33.441825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:33.443271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:33.468476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:33.469143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 856/1707] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:33.472317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:33.627482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec34698-62a1-4b7f-99b5-314e197e7ded service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:33.645767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:33.646597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:33.647528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:33.647528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] PATH_INFO: `/v3/users/558cee9d30a443ceab3c6707255f429e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:33.651777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558cee9d30a443ceab3c6707255f429e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:33.655226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:33.764282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558cee9d30a443ceab3c6707255f429e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.765944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558cee9d30a443ceab3c6707255f429e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.769592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558cee9d30a443ceab3c6707255f429e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.770991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:33.772749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:33.798828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276670-afd5-4340-b21e-ec9b4589222b service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:33.808066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558cee9d30a443ceab3c6707255f429e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.814085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:33.815170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:33.815665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:33.816120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] PATH_INFO: `/v3/projects/51017d3b1c5840a2b7067c7680cf48e1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:33.818348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51017d3b1c5840a2b7067c7680cf48e1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:33.823008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:33.831831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558cee9d30a443ceab3c6707255f429e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.864032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 852/1708] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:33 2022] DELETE /identity/v3/users/558cee9d30a443ceab3c6707255f429e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:33.910233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51017d3b1c5840a2b7067c7680cf48e1', 'request_id': 'req-3bdbd348-dfd6-419f-8938-b070a9d2dce9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.926498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51017d3b1c5840a2b7067c7680cf48e1', 'request_id': 'req-3bdbd348-dfd6-419f-8938-b070a9d2dce9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.964451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51017d3b1c5840a2b7067c7680cf48e1', 'request_id': 'req-3bdbd348-dfd6-419f-8938-b070a9d2dce9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.966162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:33.991414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] The token cache is being invalidate because project 51017d3b1c5840a2b7067c7680cf48e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:33.992328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:33.994002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.002710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 857/1709] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:33 2022] DELETE /identity/v3/projects/51017d3b1c5840a2b7067c7680cf48e1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:34.004063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:34.005777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:34.179028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f64f-9f52-47e1-bd8d-d0e5fc06d4f2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:34.204339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:34.340184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:34.341484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:34.356220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:34.359495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:34.363906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:34.364688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] PATH_INFO: `/v3/users/0d8071955d064594beaea5e67a503f73` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:34.368603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8071955d064594beaea5e67a503f73)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:34.370603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:34.471033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd348-dfd6-419f-8938-b070a9d2dce9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:34.480149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:34.480982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:34.481269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:34.482170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] PATH_INFO: `/v3/projects/22868c9a79c94eb29544b9209a0f1ba7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:34.483497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22868c9a79c94eb29544b9209a0f1ba7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:34.486531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:34.490914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8071955d064594beaea5e67a503f73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.491703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8071955d064594beaea5e67a503f73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.493164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8071955d064594beaea5e67a503f73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.516938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8071955d064594beaea5e67a503f73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.526422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8071955d064594beaea5e67a503f73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.552922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 853/1710] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:34 2022] DELETE /identity/v3/users/0d8071955d064594beaea5e67a503f73 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:34.571278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22868c9a79c94eb29544b9209a0f1ba7', 'request_id': 'req-26f407d2-25a4-4ece-a6ad-ee67019f1f19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.579441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22868c9a79c94eb29544b9209a0f1ba7', 'request_id': 'req-26f407d2-25a4-4ece-a6ad-ee67019f1f19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.596224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22868c9a79c94eb29544b9209a0f1ba7', 'request_id': 'req-26f407d2-25a4-4ece-a6ad-ee67019f1f19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.634152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] The token cache is being invalidate because project 22868c9a79c94eb29544b9209a0f1ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:34.636313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.637696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.641103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 858/1711] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:34 2022] DELETE /identity/v3/projects/22868c9a79c94eb29544b9209a0f1ba7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:34.645195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:34.646924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:34.759702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da8fb-25ad-440e-8e5d-3f43cdfdc17a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:34.767577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:34.768557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:34.769163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:34.770125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] PATH_INFO: `/v3/users/b0256c8fcfe747128611b7ad90fd4628` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:34.772461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0256c8fcfe747128611b7ad90fd4628)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:34.776277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:34.839866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:34.866438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0256c8fcfe747128611b7ad90fd4628'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.868451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0256c8fcfe747128611b7ad90fd4628'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.869473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0256c8fcfe747128611b7ad90fd4628'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.892598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0256c8fcfe747128611b7ad90fd4628'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.910458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0256c8fcfe747128611b7ad90fd4628'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:34.939040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 854/1712] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:34 2022] DELETE /identity/v3/users/b0256c8fcfe747128611b7ad90fd4628 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:35.134587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:35.136105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:35.265015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:35.266617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:35.347773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f407d2-25a4-4ece-a6ad-ee67019f1f19 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:35.441691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:35.494738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aeb2d-9a21-4d53-b78b-99e77bfe2136 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:35.505208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:35.505990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:35.506387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:35.506708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] PATH_INFO: `/v3/projects/2fd1c618b5f641b3b8db1259e88a94c1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:35.508639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd1c618b5f641b3b8db1259e88a94c1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:35.511358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:35.511478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:35.511660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:35.511914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:35.512206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] PATH_INFO: `/v3/projects/823296ba64424a31bb3c2d09bf0cc48a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:35.515066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823296ba64424a31bb3c2d09bf0cc48a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:35.518936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:35.657422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd1c618b5f641b3b8db1259e88a94c1', 'request_id': 'req-fa708a4b-5d79-4b21-9193-01de33a231fa'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.662590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823296ba64424a31bb3c2d09bf0cc48a', 'request_id': 'req-7f239560-542a-4533-ab58-a31022490417'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.677031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd1c618b5f641b3b8db1259e88a94c1', 'request_id': 'req-fa708a4b-5d79-4b21-9193-01de33a231fa'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.682311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823296ba64424a31bb3c2d09bf0cc48a', 'request_id': 'req-7f239560-542a-4533-ab58-a31022490417'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.696454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd1c618b5f641b3b8db1259e88a94c1', 'request_id': 'req-fa708a4b-5d79-4b21-9193-01de33a231fa'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.704301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823296ba64424a31bb3c2d09bf0cc48a', 'request_id': 'req-7f239560-542a-4533-ab58-a31022490417'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.719224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] The token cache is being invalidate because project 2fd1c618b5f641b3b8db1259e88a94c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:35.722272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.726005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa708a4b-5d79-4b21-9193-01de33a231fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.732446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 855/1713] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:35 2022] DELETE /identity/v3/projects/2fd1c618b5f641b3b8db1259e88a94c1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:35.736955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74a7a-265b-4120-8863-7c57cef9c57c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:35.739372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] The token cache is being invalidate because project 823296ba64424a31bb3c2d09bf0cc48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:35.739673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.740562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74a7a-265b-4120-8863-7c57cef9c57c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:35.741499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7f239560-542a-4533-ab58-a31022490417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:35.742081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74a7a-265b-4120-8863-7c57cef9c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:35.748559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 859/1714] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:35 2022] DELETE /identity/v3/projects/823296ba64424a31bb3c2d09bf0cc48a => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:35.754887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54bbc-34ae-41db-bc10-ab5a86d9d217 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:35.755180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54bbc-34ae-41db-bc10-ab5a86d9d217 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:35.755453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54bbc-34ae-41db-bc10-ab5a86d9d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:35.797877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-30e74a7a-265b-4120-8863-7c57cef9c57c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:35.808460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30e74a7a-265b-4120-8863-7c57cef9c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:35.814405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9af54bbc-34ae-41db-bc10-ab5a86d9d217 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:35.820339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9af54bbc-34ae-41db-bc10-ab5a86d9d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:35.923464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:35.986726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 856/1715] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:35.989873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:35.990167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:35.990442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.005271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 860/1716] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:36.013643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.013937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.014224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.042597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:36.044623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:36.050992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:36.052291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:36.056977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 861/1717] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:36.060938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.077836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199205-7863-439c-b0f6-e0ded7bc0f51 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.081368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 857/1718] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:36.086111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.087276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.087467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.087734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.088799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:36.089018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.091064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.095179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.109584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 862/1719] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:36.113989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.127186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecad4-fa16-426e-9c95-69385b164bb0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.131833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64d6e-8fcc-4b3e-b578-edff9a4230ad admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.144678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.150795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.151230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.151594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.154257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:36.156821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.157198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.159563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.159988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.160221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.163115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.163487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.175543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.246013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 858/1720] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:36.248147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.257180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 863/1721] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:36.261222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.281008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf904-ebef-4220-bbd8-f7a3a423fc06 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.297512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:36.365892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32eb6-ede7-43b9-90e1-065018ab0743 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.372202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.373150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.373625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.374114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.374951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.377160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.408731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 864/1722] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/users => generated 284 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:36.414458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.421010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.421903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.422334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.422607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.425576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.430241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.436979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939b9d5-3749-4403-a5e9-97539b96d030 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.449602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.450249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.450515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.450853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.453434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.455123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.474604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 865/1723] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:20:36.481924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.491320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 859/1724] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:36.498920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.515084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449122c-8f5c-4646-b58d-02d52916bc44 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.591451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61d6d-a31b-4c52-9853-e3bd6b2533d0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.603236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.603884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.604508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.604797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.605432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.608288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.626423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.629968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.630303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.630581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.631254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.633407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.650319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 866/1725] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:36.651369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.659290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 860/1726] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:36.660321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.670213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f069e99-079c-47e7-b260-390038ba31bb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.673343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c57f-6d3f-4820-8be8-497ca9d9673d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.678687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.679526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.680045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.680425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.681383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524f32-17b1-4585-8977-c874f3238a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.682074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f32-17b1-4585-8977-c874f3238a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.683170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f32-17b1-4585-8977-c874f3238a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.683170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f32-17b1-4585-8977-c874f3238a60 admin admin] PATH_INFO: `/v3/projects/d883870c86884e35949deeb3d9ec7335/users/2ee429e7096b4ad5af26b79a4f5656d9/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.685474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.687545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.704275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524f32-17b1-4585-8977-c874f3238a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d883870c86884e35949deeb3d9ec7335, user_id=2ee429e7096b4ad5af26b79a4f5656d9, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.705367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 861/1727] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:36.707288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524f32-17b1-4585-8977-c874f3238a60 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.709329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.736688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5df6-f2ae-4c90-a271-00bfc4872c11 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.741481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 867/1728] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:36 2022] PUT /identity/v3/projects/d883870c86884e35949deeb3d9ec7335/users/2ee429e7096b4ad5af26b79a4f5656d9/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:36.752892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.753312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.755824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.814299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:36.834512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] MFA Rules not processed for user `2ee429e7096b4ad5af26b79a4f5656d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:36.835867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:36.873381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.874262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.874614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.874957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.875772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.877507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.900915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 862/1729] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:20:36.908601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:36.924116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9167c-1a23-4725-a7e8-cc84831e1d23 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:36.929873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606750-f9dd-4487-a6c5-49e6b4a08441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:36.935740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606750-f9dd-4487-a6c5-49e6b4a08441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:36.936205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606750-f9dd-4487-a6c5-49e6b4a08441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:36.937025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606750-f9dd-4487-a6c5-49e6b4a08441 admin admin] PATH_INFO: `/v3/projects/633ce88074184f65bb432c30cc09455a/users/33a8707297f04c9abf44f8408365b133/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:36.970042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:36.975141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606750-f9dd-4487-a6c5-49e6b4a08441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633ce88074184f65bb432c30cc09455a, user_id=33a8707297f04c9abf44f8408365b133, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:36.978912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606750-f9dd-4487-a6c5-49e6b4a08441 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:36.985122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 868/1730] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:36.989237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.007310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e027c-098a-4054-b3d0-daa7bc9e88e9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.016399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 863/1731] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:36 2022] PUT /identity/v3/projects/633ce88074184f65bb432c30cc09455a/users/33a8707297f04c9abf44f8408365b133/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:37.021093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf763-b515-4368-ad30-e60b256654cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.021383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf763-b515-4368-ad30-e60b256654cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.021674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf763-b515-4368-ad30-e60b256654cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.084448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-866bf763-b515-4368-ad30-e60b256654cf None None] MFA Rules not processed for user `33a8707297f04c9abf44f8408365b133`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:37.085709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-866bf763-b515-4368-ad30-e60b256654cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:37.134803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.137426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.137710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.137987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.138626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.140593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.251413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 869/1732] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:36 2022] POST /identity/v3/projects => generated 369 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:37.255509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.280108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 864/1733] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:37.284525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf763-b515-4368-ad30-e60b256654cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.301206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf763-b515-4368-ad30-e60b256654cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.423531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.424292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.424605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.424913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.425906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.428066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.449948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775f5c4-9453-4f12-b88b-35c71b2af6ce admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.456423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.464265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.464841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.465292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.466119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.468307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.506716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 870/1734] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:37 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:37.510279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 865/1735] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:37 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:37.513996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.515319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.537958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215f772-caee-436c-a951-db093a9efa98 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.551279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:37.699301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.699949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.700983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.701280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.706466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.707926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.720443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545c1d-da22-4659-a75e-b87212066d13 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.736747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 871/1736] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:37.736747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.749296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.749932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.750218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.750492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.751481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.754844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.763152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc5bd-7d54-4ba8-869a-a40ef097225b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.771853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.773064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.773064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.777285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] PATH_INFO: `/v3/projects/50d7484111664a1da575a8b0b6a120dd/users/777d08ee065a4a3f9b2f7730b38b3beb/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.823070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 866/1737] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:37 2022] POST /identity/v3/users => generated 296 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:37.827093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:37.828898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.852809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d7484111664a1da575a8b0b6a120dd, user_id=777d08ee065a4a3f9b2f7730b38b3beb, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.856065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.857589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a4118-2939-4f73-9de8-e11ee6217bed admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:37.877104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71332831-a4fe-4a7f-8d28-1b4436c18cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:37.886044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332831-a4fe-4a7f-8d28-1b4436c18cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.886407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332831-a4fe-4a7f-8d28-1b4436c18cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.886688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332831-a4fe-4a7f-8d28-1b4436c18cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.887440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71332831-a4fe-4a7f-8d28-1b4436c18cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:37.891343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71332831-a4fe-4a7f-8d28-1b4436c18cdb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:37.915312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 872/1738] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:37 2022] PUT /identity/v3/projects/50d7484111664a1da575a8b0b6a120dd/users/777d08ee065a4a3f9b2f7730b38b3beb/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:37.928002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:37.931018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 867/1739] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:37.932631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:37.942305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:37.942305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:37.995267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] MFA Rules not processed for user `b5872d0410214dd6b44c36c7952a5ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:37.999872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:38.173952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16551daa-e588-4aaf-8c5d-51d0ba8bdc17 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.188783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.189417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.189698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.190042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.190618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.192275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.209498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 868/1740] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:38.216509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:38.220342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 873/1741] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:38.224985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:38.261658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5e58-4b92-4685-a43b-e5d88d85387d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.273644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c3ca7-3136-4d6e-a1f2-c0ed172628d7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.275774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bc72b-227e-48b9-8937-ebea945bee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.276926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bc72b-227e-48b9-8937-ebea945bee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.277216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bc72b-227e-48b9-8937-ebea945bee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.277565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bc72b-227e-48b9-8937-ebea945bee6b admin admin] PATH_INFO: `/v3/projects/50d7484111664a1da575a8b0b6a120dd/users/777d08ee065a4a3f9b2f7730b38b3beb/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.279448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.280261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.280705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.281054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] PATH_INFO: `/v3/projects/3bf3b21ffd30403b8a50234ad1b36316/users/27c5d2ca1a6f466da705e21bd712e7a9/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.282574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bc72b-227e-48b9-8937-ebea945bee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d7484111664a1da575a8b0b6a120dd, user_id=777d08ee065a4a3f9b2f7730b38b3beb, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.287688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bc72b-227e-48b9-8937-ebea945bee6b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.315664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf3b21ffd30403b8a50234ad1b36316, user_id=27c5d2ca1a6f466da705e21bd712e7a9, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.327793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 874/1742] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:38 2022] PUT /identity/v3/projects/50d7484111664a1da575a8b0b6a120dd/users/777d08ee065a4a3f9b2f7730b38b3beb/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:38.328175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.330683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.334073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.334073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.346476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 869/1743] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:38 2022] PUT /identity/v3/projects/3bf3b21ffd30403b8a50234ad1b36316/users/27c5d2ca1a6f466da705e21bd712e7a9/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:38.352153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:38.448911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] MFA Rules not processed for user `777d08ee065a4a3f9b2f7730b38b3beb`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:38.450612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:38.534221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d9221-2843-4d1c-bf45-dedc294c3898 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.545372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.546111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.548428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.548793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.549603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.552452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.579947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 870/1744] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:20:38.584168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:38.607735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4b31a-38ae-4d27-a57d-b1a19eb93a69 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.612735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 875/1745] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:38.621123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:38.622496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80d185-e733-4e84-ab09-9deeee97971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.623291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80d185-e733-4e84-ab09-9deeee97971f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.623633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80d185-e733-4e84-ab09-9deeee97971f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.623997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80d185-e733-4e84-ab09-9deeee97971f admin admin] PATH_INFO: `/v3/projects/3bf3b21ffd30403b8a50234ad1b36316/users/27c5d2ca1a6f466da705e21bd712e7a9/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.624319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:38.628600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80d185-e733-4e84-ab09-9deeee97971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf3b21ffd30403b8a50234ad1b36316, user_id=27c5d2ca1a6f466da705e21bd712e7a9, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.631506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80d185-e733-4e84-ab09-9deeee97971f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.641890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:38.658691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 871/1746] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:38 2022] PUT /identity/v3/projects/3bf3b21ffd30403b8a50234ad1b36316/users/27c5d2ca1a6f466da705e21bd712e7a9/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:38.669659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.670119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.670537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.741586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] MFA Rules not processed for user `27c5d2ca1a6f466da705e21bd712e7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:38.743300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:38.783561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926e6df-0e1e-4b87-b266-31c58f6c078d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.795498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:38.870532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.871348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.872023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.874031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.909807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 872/1747] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:38.921821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:38.923401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:38.947819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be141ad-33df-47fe-ac13-4a67c5f864cd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:38.957684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:38.958419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:38.958781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:38.959348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:38.968223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.969958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.984358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:38.985989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:38.998216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 876/1748] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:39.018700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 873/1749] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:20:39.083224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:39.101123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370bbc4-f4ea-4184-a748-e642428af385 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:39.112226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:39.113533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:39.114681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:39.115758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:39.216226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:39.227389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788c6eb-e619-46ad-b12d-899d5f8f5125 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:39.243591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb52fc-a7bd-4879-ad60-866c300a26ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:39.244428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb52fc-a7bd-4879-ad60-866c300a26ef service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:39.244979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb52fc-a7bd-4879-ad60-866c300a26ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:39.245261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb52fc-a7bd-4879-ad60-866c300a26ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:39.253078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:39.255161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:39.271449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 877/1750] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:39.382560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb52fc-a7bd-4879-ad60-866c300a26ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:39.384617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb52fc-a7bd-4879-ad60-866c300a26ef service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:39.406644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 874/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:20:40.922288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:40.923840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:41.121483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b36a3-aa91-41c4-abe2-e86393195687 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:41.132986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:41.133651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:41.133935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:41.134295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] PATH_INFO: `/v3/users/28eb24deb331468fbf310d7e4c5e50f1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:41.135626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eb24deb331468fbf310d7e4c5e50f1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:41.137610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:41.139376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:41.162327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f90494-6c7c-4528-869b-7e072097e5de None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:41.162875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f90494-6c7c-4528-869b-7e072097e5de None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:41.162875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f90494-6c7c-4528-869b-7e072097e5de None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:41.165549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 875/1752] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 17 14:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:41.176171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:41.176504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:41.176728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:41.245978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eb24deb331468fbf310d7e4c5e50f1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:41.260263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eb24deb331468fbf310d7e4c5e50f1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:41.261860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eb24deb331468fbf310d7e4c5e50f1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:41.276802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eb24deb331468fbf310d7e4c5e50f1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:41.306553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b566-2902-458c-bfc7-5a3960847015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eb24deb331468fbf310d7e4c5e50f1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:41.325106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:41.326644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:41.328155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 878/1753] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:40 2022] DELETE /identity/v3/users/28eb24deb331468fbf310d7e4c5e50f1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:41.329569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:41.329856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:41.330135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:41.377589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:41.385568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:41.496001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 876/1754] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:20:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:41.538497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:41.540838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:41.547029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:41.556137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c778db-31d4-46cd-bb15-006a718dd84c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:41.563972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 879/1755] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:41.570635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c053cb-8b91-427e-9a19-9f8724b6d7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:41.571353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c053cb-8b91-427e-9a19-9f8724b6d7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:41.571639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c053cb-8b91-427e-9a19-9f8724b6d7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:41.571912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c053cb-8b91-427e-9a19-9f8724b6d7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:41.580735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c053cb-8b91-427e-9a19-9f8724b6d7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:41.582296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c053cb-8b91-427e-9a19-9f8724b6d7bd service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:41.602351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 877/1756] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:41.666156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:41.687120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e5d7f-80a5-425a-8a68-8d4feb7df11e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:41.692226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71d5b5-157f-4870-a56d-2fe56e0cd0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:41.692861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71d5b5-157f-4870-a56d-2fe56e0cd0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:41.693143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71d5b5-157f-4870-a56d-2fe56e0cd0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:41.693417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71d5b5-157f-4870-a56d-2fe56e0cd0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:41.718100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71d5b5-157f-4870-a56d-2fe56e0cd0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:41.721229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71d5b5-157f-4870-a56d-2fe56e0cd0a9 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:41.766063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 880/1757] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:42.149252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641447-2da7-42b0-8e32-97794f65328a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:42.149561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641447-2da7-42b0-8e32-97794f65328a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:42.150049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641447-2da7-42b0-8e32-97794f65328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:42.251371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-95641447-2da7-42b0-8e32-97794f65328a None None] MFA Rules not processed for user `beaa61185a6144b3b9c7db1a378c46b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:42.252640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-95641447-2da7-42b0-8e32-97794f65328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:42.431892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 878/1758] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:42.443824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:42.444738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:42.445749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:42.481574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] MFA Rules not processed for user `beaa61185a6144b3b9c7db1a378c46b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:42.483656 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:42.492343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 881/1759] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:42.520447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641447-2da7-42b0-8e32-97794f65328a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:42.522008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-95641447-2da7-42b0-8e32-97794f65328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:42.768464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641447-2da7-42b0-8e32-97794f65328a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:42.785112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485817c-d63d-46a8-804d-5d8cd6e4a15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:42.785758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485817c-d63d-46a8-804d-5d8cd6e4a15a service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:42.786096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485817c-d63d-46a8-804d-5d8cd6e4a15a service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:42.786379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485817c-d63d-46a8-804d-5d8cd6e4a15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:42.806694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485817c-d63d-46a8-804d-5d8cd6e4a15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:42.808354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485817c-d63d-46a8-804d-5d8cd6e4a15a service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:42.838367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 879/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:43.229414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:43.230913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:43.319859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:43.327215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c87b7-325f-41d4-a608-214b958b2cbd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:43.352589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:43.353399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:43.353682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:43.353959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:43.360620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:43.386568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:43.389411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:43.404177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 882/1761] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:43.448508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e1388-bdf6-40e3-b8b8-9bb35f89231b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:43.449915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e1388-bdf6-40e3-b8b8-9bb35f89231b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:43.450203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e1388-bdf6-40e3-b8b8-9bb35f89231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:43.549392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-be2e1388-bdf6-40e3-b8b8-9bb35f89231b None None] MFA Rules not processed for user `c444d49243af4f2994bdc510e59dbe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:43.553472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-be2e1388-bdf6-40e3-b8b8-9bb35f89231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:43.625672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:43.627298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:43.655275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4f72d-e299-4519-a2eb-951943ff560e service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:43.683296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:43.685004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:43.685952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:43.688300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] PATH_INFO: `/v3/projects/0df1facd759b442e88b9d5a09939885c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:43.692896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df1facd759b442e88b9d5a09939885c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:43.701295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:43.720009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:43.794411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 880/1762] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:43.796968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31846724-f195-422e-a0a4-096a16c09d9c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:43.798977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31846724-f195-422e-a0a4-096a16c09d9c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:43.799254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31846724-f195-422e-a0a4-096a16c09d9c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:43.801847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 881/1763] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 17 14:20:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:43.802499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31846724-f195-422e-a0a4-096a16c09d9c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:43.804810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-31846724-f195-422e-a0a4-096a16c09d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:43.850575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31846724-f195-422e-a0a4-096a16c09d9c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:43.885697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df1facd759b442e88b9d5a09939885c', 'request_id': 'req-b2df99cc-df49-4d19-9fed-2b74a9be8805'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:43.907054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df1facd759b442e88b9d5a09939885c', 'request_id': 'req-b2df99cc-df49-4d19-9fed-2b74a9be8805'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:43.927443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df1facd759b442e88b9d5a09939885c', 'request_id': 'req-b2df99cc-df49-4d19-9fed-2b74a9be8805'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:43.962021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] The token cache is being invalidate because project 0df1facd759b442e88b9d5a09939885c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:43.962338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:43.969830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2df99cc-df49-4d19-9fed-2b74a9be8805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:43.976143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 883/1764] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:43 2022] DELETE /identity/v3/projects/0df1facd759b442e88b9d5a09939885c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:43.980162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:43.980461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:43.980742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:44.034348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:44.035975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:44.056765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:44.057245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:44.060836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:44.061144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:44.066941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:44.211981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 884/1765] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:44.214964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:44.219095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:44.262142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:44.263939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090dafe-4cff-48db-8faa-8d25db102692 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:44.285336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 882/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:44.298304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:44.298600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:44.298877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:44.395616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e853-f5e2-4ba6-962d-22178c2cc873 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:44.414738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:44.415992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:44.416892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:44.418463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] PATH_INFO: `/v3/users/8ab2195ef97448e38907801d58ea4693` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:44.423425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab2195ef97448e38907801d58ea4693)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:44.426757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:44.432595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] MFA Rules not processed for user `9ce6fbb5e7264feb816242192bcbf900`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:44.442742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:44.514118 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:44.596084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 883/1767] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:44.597724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:44.600676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:44.626675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab2195ef97448e38907801d58ea4693'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:44.640947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf0e3-c484-44c8-b268-7b4c7d4df96c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:44.652374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab2195ef97448e38907801d58ea4693'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:44.655943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab2195ef97448e38907801d58ea4693'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:44.658385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff607a-99cf-4f4d-9cae-1c284447e173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:44.660950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff607a-99cf-4f4d-9cae-1c284447e173 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:44.661860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff607a-99cf-4f4d-9cae-1c284447e173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:44.663928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff607a-99cf-4f4d-9cae-1c284447e173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:44.691868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff607a-99cf-4f4d-9cae-1c284447e173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:44.693972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff607a-99cf-4f4d-9cae-1c284447e173 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:44.715586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab2195ef97448e38907801d58ea4693'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:44.725859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 884/1768] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:44.729208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:44.731117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:44.732152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:44.759302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab2195ef97448e38907801d58ea4693'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:44.796748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 885/1769] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:44 2022] DELETE /identity/v3/users/8ab2195ef97448e38907801d58ea4693 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:44.808426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:44.818576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] MFA Rules not processed for user `9ce6fbb5e7264feb816242192bcbf900`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:44.821910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:44.825468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:44.826887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:45.089404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f85e-a721-4e93-afeb-cfc7ee9a3ab3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:45.096628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 885/1770] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:45.107045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:45.110126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:45.111900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:45.112347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:45.112601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:45.114589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] PATH_INFO: `/v3/users/2ee429e7096b4ad5af26b79a4f5656d9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:45.117814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee429e7096b4ad5af26b79a4f5656d9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:45.123257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:45.239849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee429e7096b4ad5af26b79a4f5656d9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:45.253857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee429e7096b4ad5af26b79a4f5656d9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:45.256406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee429e7096b4ad5af26b79a4f5656d9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:45.285265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee429e7096b4ad5af26b79a4f5656d9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:45.302322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34494f9e-580e-4093-810c-eb7864745bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee429e7096b4ad5af26b79a4f5656d9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:45.322640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 886/1771] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:44 2022] DELETE /identity/v3/users/2ee429e7096b4ad5af26b79a4f5656d9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:45.324195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:45.325586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:45.326146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:45.368404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:45.374225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:45.375261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d0d30-9db1-4c3a-8d91-654d8978dedc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:45.421934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:45.538212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 887/1772] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:45.558343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:45.559023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:45.559314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:45.559589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:45.563086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:45.564581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:45.564781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:45.778588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:45.820225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820ec73-eb56-4831-84f5-66059febc48d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:45.825484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:45.830814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34cd04-0abe-4b02-917e-762e1ca1d7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:45.831473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34cd04-0abe-4b02-917e-762e1ca1d7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:45.832267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34cd04-0abe-4b02-917e-762e1ca1d7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:45.832556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34cd04-0abe-4b02-917e-762e1ca1d7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:45.832745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:45.857107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34cd04-0abe-4b02-917e-762e1ca1d7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:45.858205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 886/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:45.863243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34cd04-0abe-4b02-917e-762e1ca1d7d8 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:45.888182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 888/1774] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:20:45.906042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:45.911802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:45.950033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca9ca-c321-4ad5-82e6-30e4cb1776d4 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:45.977707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:45.978586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:45.978974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:45.979347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] PATH_INFO: `/v3/projects/2c81a651d213469f9ff1be5dfafe0d57` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:45.981273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c81a651d213469f9ff1be5dfafe0d57)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:45.983312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:46.128277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c81a651d213469f9ff1be5dfafe0d57', 'request_id': 'req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:46.138122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c81a651d213469f9ff1be5dfafe0d57', 'request_id': 'req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:46.152105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c81a651d213469f9ff1be5dfafe0d57', 'request_id': 'req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:46.177399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] The token cache is being invalidate because project 2c81a651d213469f9ff1be5dfafe0d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:46.177399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:46.178414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bd5fdbc4-cb0f-43c6-83da-a9948e44c60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:46.183453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 887/1775] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:45 2022] DELETE /identity/v3/projects/2c81a651d213469f9ff1be5dfafe0d57 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:46.188189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:46.188484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:46.188767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:46.236915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:46.238189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:46.411124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 889/1776] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:46.414216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:46.414585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:46.414970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:46.476980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:46.496949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:46.518212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 888/1777] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:46.522970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:46.541287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a0463-c06e-446f-bdf7-5f6f62adeefa None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:46.567870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:46.571536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:46.573573 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:46.573983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:46.574803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:46.578110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:46.582243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:46.625001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:46.641147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 890/1778] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:46.647165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbf5fb-2644-4af5-8113-6edb90255af4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:46.661008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:46.661656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:46.661935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:46.662205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:46.662848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:46.671429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:46.732193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 889/1779] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:46 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:46.733781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:46.748085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53312-718f-4b53-9009-86df297ac721 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:47.002170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:47.043905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:47.044579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.045119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.047699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.048396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:47.054623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:47.128931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 891/1780] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:46 2022] POST /identity/v3/users => generated 292 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:47.130237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:47.148543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930eaf8-2106-4cce-8656-16642e476d7d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:47.163979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:47.164770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.165064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.165345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.166016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:47.167855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:47.198362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 890/1781] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:47.202080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:47.218537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb23b7-dcc2-4901-bca4-323e56058495 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:47.255882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:47.257942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.257942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.259251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.259466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:47.261463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:47.294540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 892/1782] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:47.295713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:47.310892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacab257-dd0d-48f7-8193-d2f1d58cdcbc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:47.323721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:47.324771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073f11-f893-442a-9dfa-b97355310009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:47.325617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073f11-f893-442a-9dfa-b97355310009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.325937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073f11-f893-442a-9dfa-b97355310009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.326165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073f11-f893-442a-9dfa-b97355310009 admin admin] PATH_INFO: `/v3/projects/cc999de951ff4b6581184b2a38fa133e/users/998bd13e6d4846179c9a65bf53bdf9ad/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.326625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:47.348075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d5c59-76a4-480e-af60-008b7ed23374 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:47.363192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb073f11-f893-442a-9dfa-b97355310009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc999de951ff4b6581184b2a38fa133e, user_id=998bd13e6d4846179c9a65bf53bdf9ad, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:47.366532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb073f11-f893-442a-9dfa-b97355310009 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:47.366674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:47.367169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.367581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.367979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] PATH_INFO: `/v3/users/33a8707297f04c9abf44f8408365b133` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.371715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a8707297f04c9abf44f8408365b133)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:47.378239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:47.431797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 891/1783] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:47 2022] PUT /identity/v3/projects/cc999de951ff4b6581184b2a38fa133e/users/998bd13e6d4846179c9a65bf53bdf9ad/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:47.433513 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7265-a7b0-4412-9f46-1cfd1e2e08c8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.433984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7265-a7b0-4412-9f46-1cfd1e2e08c8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.434266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7265-a7b0-4412-9f46-1cfd1e2e08c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.483906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a8707297f04c9abf44f8408365b133'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:47.505632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a8707297f04c9abf44f8408365b133'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:47.506583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a8707297f04c9abf44f8408365b133'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:47.524685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5f6c7265-a7b0-4412-9f46-1cfd1e2e08c8 None None] MFA Rules not processed for user `998bd13e6d4846179c9a65bf53bdf9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:47.532470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5f6c7265-a7b0-4412-9f46-1cfd1e2e08c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:47.536690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a8707297f04c9abf44f8408365b133'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:47.557197 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1c3bd74-9e23-402b-913e-47be2c36b2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a8707297f04c9abf44f8408365b133'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:47.568550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 893/1784] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:47 2022] DELETE /identity/v3/users/33a8707297f04c9abf44f8408365b133 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:47.568550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.568550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.568550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.701967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:47.703403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:47.735738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:47.757731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 892/1785] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:20:47.759303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:47.759729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:47.760213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:47.809092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:47.810635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:47.883238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 894/1786] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:47.884291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:47.893282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:47.945697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:47.985519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 893/1787] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:47.986514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:47.991105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:48.046832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa1c5-12fe-4712-bffe-dee7afc0ba7e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:48.076401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:48.077046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:48.077332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:48.077606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:48.078256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:48.090420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:48.169700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 894/1788] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:47 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:48.172748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:48.179307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:48.199996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b04e84-bb12-441a-b192-ecb85a269cd9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:48.327209 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:48.328141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:48.328537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:48.328910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] PATH_INFO: `/v3/projects/d883870c86884e35949deeb3d9ec7335` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:48.330526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d883870c86884e35949deeb3d9ec7335)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:48.333717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:48.378351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0a799-1383-471c-9825-b672382858ab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:48.403376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:48.405957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:48.407496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:48.408224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:48.448650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:48.454046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:48.484613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd883870c86884e35949deeb3d9ec7335', 'request_id': 'req-d22eb075-e0e9-4241-98fc-7a0f1acc481f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:48.519627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 895/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:48.522335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd883870c86884e35949deeb3d9ec7335', 'request_id': 'req-d22eb075-e0e9-4241-98fc-7a0f1acc481f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:48.525295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:48.544798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd883870c86884e35949deeb3d9ec7335', 'request_id': 'req-d22eb075-e0e9-4241-98fc-7a0f1acc481f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:48.555241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50448b-c86a-4272-8f88-5defa237086e service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:48.594734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] The token cache is being invalidate because project d883870c86884e35949deeb3d9ec7335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:48.595098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:48.598055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:48.608053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 895/1790] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:47 2022] DELETE /identity/v3/projects/d883870c86884e35949deeb3d9ec7335 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:48.610171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:48.613720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:48.718718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:48.719438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:48.719835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:48.720140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:48.720776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:48.730912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:48.808203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 896/1791] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:48 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:48.809955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:48.815759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:48.833674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:48.864004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ec58b-f9ed-4dcb-9680-31987856101e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:48.876330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:48.879741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:48.879741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:48.880240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] PATH_INFO: `/v3/users/777d08ee065a4a3f9b2f7730b38b3beb` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:48.884419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777d08ee065a4a3f9b2f7730b38b3beb)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:48.886794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:48.888811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:48.953965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb075-e0e9-4241-98fc-7a0f1acc481f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:48.971198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:48.972325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:48.973094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:48.977077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:48.982161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:49.031014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777d08ee065a4a3f9b2f7730b38b3beb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:49.034572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777d08ee065a4a3f9b2f7730b38b3beb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:49.035428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777d08ee065a4a3f9b2f7730b38b3beb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:49.069027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777d08ee065a4a3f9b2f7730b38b3beb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:49.092214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777d08ee065a4a3f9b2f7730b38b3beb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:49.179377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:49.182157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:49.195280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 897/1792] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:48 2022] DELETE /identity/v3/users/777d08ee065a4a3f9b2f7730b38b3beb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:49.196708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:49.209792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 896/1793] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:20:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:49.212875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:49.520404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8cdef-b892-4e65-898e-1d90eae93812 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:49.546547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:49.547467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:49.550288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:49.551224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:49.556214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:49.569374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:49.646918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 898/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:49.650245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:49.651772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:49.685537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c36eb-e5dd-48fe-b9ff-41dec3613a30 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:49.712408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:49.716705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:49.717004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:49.717284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] PATH_INFO: `/v3/projects/30aecbd9eed04ad49d020572902d494f/users/29855dae099f4e33a30f3054c95d8155/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:49.782308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30aecbd9eed04ad49d020572902d494f, user_id=29855dae099f4e33a30f3054c95d8155, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:49.792202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:49.852467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 897/1795] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:49 2022] PUT /identity/v3/projects/30aecbd9eed04ad49d020572902d494f/users/29855dae099f4e33a30f3054c95d8155/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:49.856894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:49.892485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e521ac-b19d-4e6f-ac7b-e2f43f9b18c9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:50.169388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e3c59-7321-4988-9f95-623db70cdf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:50.170024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3c59-7321-4988-9f95-623db70cdf58 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:50.170308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3c59-7321-4988-9f95-623db70cdf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:50.170580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3c59-7321-4988-9f95-623db70cdf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:50.181154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e3c59-7321-4988-9f95-623db70cdf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:50.182892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e3c59-7321-4988-9f95-623db70cdf58 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:50.209476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 899/1796] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:20:50.215384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:50.228319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70e73f-4fbf-49fa-b738-77819a860027 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:50.231061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:50.231348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:50.231622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:50.257944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f614b9b-7a41-4d46-8d6d-b91d46f64dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:50.258639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614b9b-7a41-4d46-8d6d-b91d46f64dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:50.258921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614b9b-7a41-4d46-8d6d-b91d46f64dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:50.259204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614b9b-7a41-4d46-8d6d-b91d46f64dd5 admin admin] PATH_INFO: `/v3/projects/30aecbd9eed04ad49d020572902d494f/users/29855dae099f4e33a30f3054c95d8155/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:50.276896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f614b9b-7a41-4d46-8d6d-b91d46f64dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30aecbd9eed04ad49d020572902d494f, user_id=29855dae099f4e33a30f3054c95d8155, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:50.299619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f614b9b-7a41-4d46-8d6d-b91d46f64dd5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:50.311688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:50.313064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:50.334443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 898/1797] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:50 2022] PUT /identity/v3/projects/30aecbd9eed04ad49d020572902d494f/users/29855dae099f4e33a30f3054c95d8155/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:50.346512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:50.347184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:50.347471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:50.347747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:50.489271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] MFA Rules not processed for user `29855dae099f4e33a30f3054c95d8155`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:50.490511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:50.591737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 900/1798] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 17 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:50.599390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:50.607024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:50.842980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 899/1799] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:50.844283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:50.847147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:50.912582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350dd4b-11e9-441f-a9b2-0659a3ec6b0b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:50.927028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdb925-b06c-43d9-bb91-cf01e5affece None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:50.933590 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:50.935986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:50.937279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:50.937666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:50.955568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:50.958561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:50.962046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:50.963423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] PATH_INFO: `/v3/projects/633ce88074184f65bb432c30cc09455a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:50.966948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:50.968870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633ce88074184f65bb432c30cc09455a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:50.977725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:50.983352 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:51.008452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 900/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:51.027044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:51.031268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:51.078850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:51.213137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633ce88074184f65bb432c30cc09455a', 'request_id': 'req-ecf38f8f-46fb-4a68-b71f-17b29a37b686'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.238863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633ce88074184f65bb432c30cc09455a', 'request_id': 'req-ecf38f8f-46fb-4a68-b71f-17b29a37b686'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.262743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633ce88074184f65bb432c30cc09455a', 'request_id': 'req-ecf38f8f-46fb-4a68-b71f-17b29a37b686'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.305475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] The token cache is being invalidate because project 633ce88074184f65bb432c30cc09455a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:51.305773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.307731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb71fbc-7014-4d76-8160-f208db4afad2 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:51.308769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.317030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 901/1801] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:50 2022] DELETE /identity/v3/projects/633ce88074184f65bb432c30cc09455a => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:51.318085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:51.327204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:51.514706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:51.516798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:51.517909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:51.519359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:51.522210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:51.528798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:51.590078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38f8f-46fb-4a68-b71f-17b29a37b686 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:51.612527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:51.613517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:51.614117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:51.614574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] PATH_INFO: `/v3/users/27c5d2ca1a6f466da705e21bd712e7a9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:51.618028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c5d2ca1a6f466da705e21bd712e7a9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:51.620297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:51.754774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c5d2ca1a6f466da705e21bd712e7a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.756402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c5d2ca1a6f466da705e21bd712e7a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.758643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c5d2ca1a6f466da705e21bd712e7a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.813263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c5d2ca1a6f466da705e21bd712e7a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.833333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f59d5342-d073-4ec6-b90f-b5fd201c1849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c5d2ca1a6f466da705e21bd712e7a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:51.856943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:51.864770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 902/1802] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:51 2022] DELETE /identity/v3/users/27c5d2ca1a6f466da705e21bd712e7a9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:51.871472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:51.872604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:51.873339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:51.873770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:51.918066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] MFA Rules not processed for user `9ce6fbb5e7264feb816242192bcbf900`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:51.920611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:51.974653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 901/1803] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 966 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:52.083645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 903/1804] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:52.260558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:52.263261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:52.293978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284e97f-81ba-4c5e-8020-7136b40ffc12 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:52.478555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:52.479396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:52.479872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:52.480301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:52.491371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:52.643040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:52.814720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:52.816837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aedbc4-83f3-4a14-b1a6-4b7581112bee service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:52.833755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 902/1805] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:52.924674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:52.927120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:53.189671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220328c-0f5d-446d-845a-aff09296d30b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:53.203894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:53.204675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:53.204962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:53.205280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] PATH_INFO: `/v3/projects/50d7484111664a1da575a8b0b6a120dd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:53.212397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d7484111664a1da575a8b0b6a120dd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:53.216010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:53.294722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:53.388145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d7484111664a1da575a8b0b6a120dd', 'request_id': 'req-754d8a1f-837f-41bc-b11b-61187dceea1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:53.412313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d7484111664a1da575a8b0b6a120dd', 'request_id': 'req-754d8a1f-837f-41bc-b11b-61187dceea1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:53.435600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d7484111664a1da575a8b0b6a120dd', 'request_id': 'req-754d8a1f-837f-41bc-b11b-61187dceea1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:53.484411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] The token cache is being invalidate because project 50d7484111664a1da575a8b0b6a120dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:53.486149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:53.488357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-754d8a1f-837f-41bc-b11b-61187dceea1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:53.498433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 904/1806] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:52 2022] DELETE /identity/v3/projects/50d7484111664a1da575a8b0b6a120dd => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:53.500488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:53.500920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:53.501215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:53.583274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:53.592060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:53.954513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 903/1807] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:53.960877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c9e-da4a-4252-b1b5-2558963b4eed None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:53.961446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c9e-da4a-4252-b1b5-2558963b4eed None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:53.961544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c9e-da4a-4252-b1b5-2558963b4eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.032681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cac80c9e-da4a-4252-b1b5-2558963b4eed None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:54.034290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cac80c9e-da4a-4252-b1b5-2558963b4eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:54.065700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 905/1808] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:54.070605 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:54.086968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372720b5-c065-425a-b40a-cde371d7b4b3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:54.095484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.095794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.096093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.111729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:54.113053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.114282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.114825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.118389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:54.118879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:54.128089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:54.157190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] MFA Rules not processed for user `c444d49243af4f2994bdc510e59dbe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:54.160116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:54.175114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 904/1809] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:54.187854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:54.226482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798c554-cfc5-4539-a51d-4142731308be admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:54.262359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:54.263488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.265661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.266807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.269955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:54.274654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:54.305988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 906/1810] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:54.343717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 905/1811] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:54 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:54.348417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:54.374037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41eb142-17f9-4747-8266-1a5cda80b6a7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:54.557624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:54.564211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.564650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.565040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.565823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:54.568106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:54.641595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 907/1812] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:54 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:54.646781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:54.669954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e94396-ce9f-4987-a4cf-a6b4ac3f7550 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:54.686620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:54.688942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.690017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.691282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.693274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:54.698188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:54.713349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 906/1813] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:54.717095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:54.743458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583d8ce-95e8-4325-a770-f2be05240e49 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:54.752182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213876-43ac-46de-aa27-f68ddcf51631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:54.753265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213876-43ac-46de-aa27-f68ddcf51631 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.753690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213876-43ac-46de-aa27-f68ddcf51631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.754059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213876-43ac-46de-aa27-f68ddcf51631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.754927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04213876-43ac-46de-aa27-f68ddcf51631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:54.757345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04213876-43ac-46de-aa27-f68ddcf51631 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:54.809034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 908/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:54.813741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:54.869105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f69c-5e1b-4fd5-8cd8-c9a0cb29baca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:54.887708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:54.890436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.890928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.891415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] PATH_INFO: `/v3/projects/fe8102f4dc0d4537a3473b074f9c5be2/users/a67bcfd7020f48c1a0dfd2ba1bb5fc8d/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:54.933591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8102f4dc0d4537a3473b074f9c5be2, user_id=a67bcfd7020f48c1a0dfd2ba1bb5fc8d, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:54.938157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:54.961854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 907/1815] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:54 2022] PUT /identity/v3/projects/fe8102f4dc0d4537a3473b074f9c5be2/users/a67bcfd7020f48c1a0dfd2ba1bb5fc8d/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:54.974564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:54.977173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:54.977666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:55.057682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] MFA Rules not processed for user `a67bcfd7020f48c1a0dfd2ba1bb5fc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:55.062751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:55.117013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:55.342786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 909/1816] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:55.347236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:55.588483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:55.592841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bb338-b9b9-46f0-bfb8-e02707b222ff admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:55.614680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:55.615550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:55.615665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:55.616503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:55.617105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:55.624346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:55.744913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 908/1817] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:55 2022] POST /identity/v3/projects => generated 381 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:55.746087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:55.773215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676a7b-45e7-4005-9c91-1570b4da65f2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:55.835476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:55.838005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:55.968071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:55.968669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:55.968952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:55.969228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:55.976001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:55.978641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.029801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 910/1818] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:55 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:56.034443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.039289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef4c6-dad3-41ea-9aad-a10f3a7e6668 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.052325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.054808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.055094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.055345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] PATH_INFO: `/v3/projects/3bf3b21ffd30403b8a50234ad1b36316` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.060897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aa229-7e8f-427f-b593-6f589bb4ad97 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.063066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf3b21ffd30403b8a50234ad1b36316)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.079202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.084002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.084685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.085138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.085735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.086077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.087715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.113466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 911/1819] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:56.117818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.153921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a11f-4632-4e98-98a8-9318bcf36867 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.169251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.171487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.171684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.171850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] PATH_INFO: `/v3/projects/45c8875da782400abad8825d6645d7ef/users/6806dcb509e144ce844ff7fbe2726c2d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.190206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf3b21ffd30403b8a50234ad1b36316', 'request_id': 'req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:56.194577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c8875da782400abad8825d6645d7ef, user_id=6806dcb509e144ce844ff7fbe2726c2d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.204504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.204897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf3b21ffd30403b8a50234ad1b36316', 'request_id': 'req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:56.220087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf3b21ffd30403b8a50234ad1b36316', 'request_id': 'req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:56.234846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] The token cache is being invalidate because project 3bf3b21ffd30403b8a50234ad1b36316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:20:56.235420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:56.236449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-385d20c8-1e24-4e2f-a855-cb2b6eafcbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:56.238713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 909/1820] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:20:55 2022] DELETE /identity/v3/projects/3bf3b21ffd30403b8a50234ad1b36316 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:56.245339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3bbc-c7c0-470e-8dfb-416d77d4e7f9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.246193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3bbc-c7c0-470e-8dfb-416d77d4e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.246515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3bbc-c7c0-470e-8dfb-416d77d4e7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.254721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 912/1821] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:56 2022] PUT /identity/v3/projects/45c8875da782400abad8825d6645d7ef/users/6806dcb509e144ce844ff7fbe2726c2d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:20:56.260612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.263044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:56.287742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-559e3bbc-c7c0-470e-8dfb-416d77d4e7f9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:56.290149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-559e3bbc-c7c0-470e-8dfb-416d77d4e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:56.396299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 910/1822] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:56.404896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4d89-a441-431f-892f-f1ab116872df None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.405195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4d89-a441-431f-892f-f1ab116872df None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.405456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4d89-a441-431f-892f-f1ab116872df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.440450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f068-0f98-4505-9042-aef6cad43a4c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.443007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-712d4d89-a441-431f-892f-f1ab116872df None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:56.445442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-712d4d89-a441-431f-892f-f1ab116872df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:56.447564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.448355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.448683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.448957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.449822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.452145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.473284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 911/1823] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:56.476006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4d89-a441-431f-892f-f1ab116872df None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.480425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 913/1824] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:56.483900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.489813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:56.497017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4d89-a441-431f-892f-f1ab116872df None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.511926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.512596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.512882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.513159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.514661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9197c4-4079-4278-b38e-7f30ae32b4ab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.517178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:56.518877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.520538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.533236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:56.536751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5f19a-e93b-430f-86b4-a12803370f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.538940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5f19a-e93b-430f-86b4-a12803370f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.539465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5f19a-e93b-430f-86b4-a12803370f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.539624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5f19a-e93b-430f-86b4-a12803370f4b admin admin] PATH_INFO: `/v3/projects/45c8875da782400abad8825d6645d7ef/users/6806dcb509e144ce844ff7fbe2726c2d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.547142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5f19a-e93b-430f-86b4-a12803370f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c8875da782400abad8825d6645d7ef, user_id=6806dcb509e144ce844ff7fbe2726c2d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.549983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5f19a-e93b-430f-86b4-a12803370f4b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.553417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 912/1825] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:56.557795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.570387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 914/1826] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:56 2022] PUT /identity/v3/projects/45c8875da782400abad8825d6645d7ef/users/6806dcb509e144ce844ff7fbe2726c2d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:56.587394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.589100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.589349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f4ec-5016-49e6-9bbb-1ed8776bda94 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.589812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.679793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] MFA Rules not processed for user `6806dcb509e144ce844ff7fbe2726c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:56.681046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:56.853711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 915/1827] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:56.856174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:56.859569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:56.877571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841edd-8a13-4d65-89d6-dcb90a27f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.881478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841edd-8a13-4d65-89d6-dcb90a27f6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.882498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841edd-8a13-4d65-89d6-dcb90a27f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.882959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841edd-8a13-4d65-89d6-dcb90a27f6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.885269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3841edd-8a13-4d65-89d6-dcb90a27f6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.893467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3841edd-8a13-4d65-89d6-dcb90a27f6c2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.897283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6f536-c8aa-40e2-80eb-a59e0469daf8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:56.908440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:56.909494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.910146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.910627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] PATH_INFO: `/v3/users/998bd13e6d4846179c9a65bf53bdf9ad` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.918653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998bd13e6d4846179c9a65bf53bdf9ad)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:56.920693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:56.974816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 913/1828] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:56 2022] POST /identity/v3/projects => generated 373 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:20:56.974816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f6dd-a362-462d-a6ab-a3c64ca6f444 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:56.976193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f6dd-a362-462d-a6ab-a3c64ca6f444 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:56.976193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f6dd-a362-462d-a6ab-a3c64ca6f444 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:56.993022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 914/1829] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:20:56 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:20:56.994383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f6dd-a362-462d-a6ab-a3c64ca6f444 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:57.002377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8fd5f6dd-a362-462d-a6ab-a3c64ca6f444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:57.136751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998bd13e6d4846179c9a65bf53bdf9ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:57.138321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998bd13e6d4846179c9a65bf53bdf9ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:57.139413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998bd13e6d4846179c9a65bf53bdf9ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:57.166595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998bd13e6d4846179c9a65bf53bdf9ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:57.177717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998bd13e6d4846179c9a65bf53bdf9ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:20:57.218375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 916/1830] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:20:56 2022] DELETE /identity/v3/users/998bd13e6d4846179c9a65bf53bdf9ad => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:57.219798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:57.221936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:57.301846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f6dd-a362-462d-a6ab-a3c64ca6f444 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:57.458632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:57.516512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0eac-4bdb-4346-85b9-3c4a02b89f75 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:57.521628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:57.522805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:57.523177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:57.523353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:57.530532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:57.541014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a5db4-509e-4b65-957b-0ca1356927eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:57.549284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a5db4-509e-4b65-957b-0ca1356927eb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:57.549575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a5db4-509e-4b65-957b-0ca1356927eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:57.553385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a5db4-509e-4b65-957b-0ca1356927eb admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:57.558598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a5db4-509e-4b65-957b-0ca1356927eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:57.572979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a5db4-509e-4b65-957b-0ca1356927eb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:57.680227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 917/1831] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:57 2022] POST /identity/v3/users => generated 287 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:57.686335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:57.686629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:57.686893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:57.765687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:57.769344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:57.769975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:57.854054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:57.863892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f757c-a23e-4e66-914b-6606ed94b4ff service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:57.919302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 915/1832] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:20:57.932155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:57.932594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:57.935442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:57.996477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:57.997846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:58.009816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 916/1833] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:58.013792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:58.034460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13199934-47c9-4b70-9f71-31354fc66e49 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:58.044587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:58.045392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:58.046089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:58.046302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 918/1834] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:20:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:58.046550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:58.047214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:58.056484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:58.082347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 917/1835] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:58.083695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:58.102558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993d9b9-956b-4fb2-888e-f3869f3ad2ae None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:58.109131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:58.114512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:58.118093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:58.118740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:58.121936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:58.122284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:58.123103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:58.125369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:58.216330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 919/1836] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:58.219571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:58.258226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653116a4-fac8-4733-9e80-07beff39e3e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:58.279214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:58.280184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:58.283006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:58.283469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] PATH_INFO: `/v3/projects/53ae838f62034404ace3c775e32c09b9/users/9ced7858b9f5457c9a8139692efdb533/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:58.298613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07354f-ee1c-481c-811e-ae6df8ae5fa3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:58.309788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c398-e717-4b47-bf83-9278a8a3aebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:58.311406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c398-e717-4b47-bf83-9278a8a3aebd service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:58.312054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c398-e717-4b47-bf83-9278a8a3aebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:58.312503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c398-e717-4b47-bf83-9278a8a3aebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:58.334261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c398-e717-4b47-bf83-9278a8a3aebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:58.339332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c398-e717-4b47-bf83-9278a8a3aebd service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:58.367669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 918/1837] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:20:58.386179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ae838f62034404ace3c775e32c09b9, user_id=9ced7858b9f5457c9a8139692efdb533, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:58.393244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:58.446446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 920/1838] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:20:58 2022] PUT /identity/v3/projects/53ae838f62034404ace3c775e32c09b9/users/9ced7858b9f5457c9a8139692efdb533/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:20:58.456991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:58.457422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:58.457850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:58.514017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] MFA Rules not processed for user `9ced7858b9f5457c9a8139692efdb533`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:20:58.517002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:58.729666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 919/1839] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:20:58.737921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:58.927910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e819dd0-bba5-4469-aa7d-561b4f3ebe08 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:58.959366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:58.962876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:58.963867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:58.964393 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:58.966779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:58.971579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:58.980861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:59.061398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 921/1840] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:58 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:59.065486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:59.125213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e13a44-3ee9-4806-9d09-447b819247ca None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:59.133426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:59.134633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:59.290111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e03f35-e887-4e67-9f64-1eedb9a4bedc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:59.304083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:59.304595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:59.304874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:59.306526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:59.306526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:59.325071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:59.340926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6806dcb509e144ce844ff7fbe2726c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c8875da782400abad8825d6645d7ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:59.341734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:59.342125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:59.342501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:59.343292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:20:59.343757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:59.345969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:59.381725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 920/1841] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:20:59.381725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:59.383603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:20:59.394698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 922/1842] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:20:59 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:59.407176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:59.432152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421b6a-5bd6-41bb-bb43-090b0c9692ee admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:59.447933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6806dcb509e144ce844ff7fbe2726c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c8875da782400abad8825d6645d7ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:59.450529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:59.450870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:59.451153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:59.451806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:59.453792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:59.548106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 923/1843] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:20:59 2022] POST /identity/v3/projects => generated 355 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:20:59.548106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:20:59.700428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676948a-887a-4ab2-9275-5a4640e73fba tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:59.812068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731fcd2-330a-4f26-a5c7-0a7f6506ab0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:20:59.827538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:20:59.829790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:20:59.830777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:20:59.831700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:20:59.833932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:20:59.839055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:20:59.914834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 924/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:20:59.919562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:00.020135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:00.024791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:00.025412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:00.026164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:00.043708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:00.046109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:00.067750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 921/1845] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:20:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:00.069577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:00.071157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:00.093817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691c3a4-d368-40d2-9a55-b8f79b474484 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:00.099774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:00.100781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:00.101262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:00.101886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] PATH_INFO: `/v3/projects/cc999de951ff4b6581184b2a38fa133e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:00.104033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc999de951ff4b6581184b2a38fa133e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:00.108115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:00.176110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:00.219278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc999de951ff4b6581184b2a38fa133e', 'request_id': 'req-0d54555b-de5e-4aca-9621-1bab02d2303d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.225942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a532af-c265-43e5-b144-639dbeea4835 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:00.231040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc999de951ff4b6581184b2a38fa133e', 'request_id': 'req-0d54555b-de5e-4aca-9621-1bab02d2303d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.245130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc999de951ff4b6581184b2a38fa133e', 'request_id': 'req-0d54555b-de5e-4aca-9621-1bab02d2303d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.292400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] The token cache is being invalidate because project cc999de951ff4b6581184b2a38fa133e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:00.292875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.293535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.295553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 922/1846] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:00 2022] DELETE /identity/v3/projects/cc999de951ff4b6581184b2a38fa133e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:00.300710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:00.305162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:00.311596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:00.404667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6806dcb509e144ce844ff7fbe2726c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c8875da782400abad8825d6645d7ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:00.405621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:00.405911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:00.406420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:00.409400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:00.409731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:00.426945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:00.500266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 925/1847] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 584 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:00.501438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:00.503674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:00.542241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54555b-de5e-4aca-9621-1bab02d2303d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:00.559722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:00.561291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:00.563134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:00.564199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] PATH_INFO: `/v3/projects/3c8951b6136f406ca92274c0139a04f4/users/6b62d4e620bd40b98a2959bc028214f4/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:00.601655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c18c9-93a3-4308-b2ba-0357aa10c1b6 tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:00.619090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:00.621042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:00.621342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:00.621616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] PATH_INFO: `/v3/users/29855dae099f4e33a30f3054c95d8155` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:00.628095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8951b6136f406ca92274c0139a04f4, user_id=6b62d4e620bd40b98a2959bc028214f4, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:00.642189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:00.642413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29855dae099f4e33a30f3054c95d8155)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:00.643065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:00.668758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 923/1848] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:00 2022] PUT /identity/v3/projects/3c8951b6136f406ca92274c0139a04f4/users/6b62d4e620bd40b98a2959bc028214f4/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:00.676319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:00.686696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:00.896292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29855dae099f4e33a30f3054c95d8155'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.897528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29855dae099f4e33a30f3054c95d8155'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.906773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29855dae099f4e33a30f3054c95d8155'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.942231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631baf-4077-4d61-a4bb-a99bce9d6242 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:00.947699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6806dcb509e144ce844ff7fbe2726c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c8875da782400abad8825d6645d7ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:00.948654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:00.949112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:00.949586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] PATH_INFO: `/v3/projects/3616ee79b2f24717947ff24449800e78` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:00.952553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3616ee79b2f24717947ff24449800e78)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:00.953910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29855dae099f4e33a30f3054c95d8155'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:00.955128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:00.997015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29855dae099f4e33a30f3054c95d8155'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:01.056302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 926/1849] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:00 2022] DELETE /identity/v3/users/29855dae099f4e33a30f3054c95d8155 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:01.059317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:01.063905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:01.072104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:01.118018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3616ee79b2f24717947ff24449800e78', 'request_id': 'req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:01.134238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3616ee79b2f24717947ff24449800e78', 'request_id': 'req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:01.147636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3616ee79b2f24717947ff24449800e78', 'request_id': 'req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:01.188104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] The token cache is being invalidate because project 3616ee79b2f24717947ff24449800e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:01.188860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:01.196218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:01.208700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 924/1850] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:00 2022] DELETE /identity/v3/projects/3616ee79b2f24717947ff24449800e78 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:01.253158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f6ac1-8459-46e9-a09e-96d5c445f4a7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:01.341087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:01.368339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e5c27-fe18-414a-9cad-19c514f98d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:01.370116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e5c27-fe18-414a-9cad-19c514f98d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.371072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e5c27-fe18-414a-9cad-19c514f98d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.371642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e5c27-fe18-414a-9cad-19c514f98d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.373808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e5c27-fe18-414a-9cad-19c514f98d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:01.376128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e5c27-fe18-414a-9cad-19c514f98d62 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:01.393791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 927/1851] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:01.400933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:01.402912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:01.423839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea212a-fb70-4caf-a7f1-55d5f7c08d0c tempest-VolumeQuotaClassesTest-1763328438 tempest-VolumeQuotaClassesTest-1763328438-project-admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:01.430103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e801e2-181f-4c87-a73d-293cfc595c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:01.431678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e801e2-181f-4c87-a73d-293cfc595c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.433089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e801e2-181f-4c87-a73d-293cfc595c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.433089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e801e2-181f-4c87-a73d-293cfc595c76 admin admin] PATH_INFO: `/v3/projects/3c8951b6136f406ca92274c0139a04f4/users/6b62d4e620bd40b98a2959bc028214f4/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.434978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e801e2-181f-4c87-a73d-293cfc595c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8951b6136f406ca92274c0139a04f4, user_id=6b62d4e620bd40b98a2959bc028214f4, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:01.438357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e801e2-181f-4c87-a73d-293cfc595c76 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:01.453210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 925/1852] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:01 2022] PUT /identity/v3/projects/3c8951b6136f406ca92274c0139a04f4/users/6b62d4e620bd40b98a2959bc028214f4/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:01.464734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.465219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.465548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.480955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324c817-f140-4985-8fdc-dd117fc50527 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.482431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324c817-f140-4985-8fdc-dd117fc50527 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.484004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324c817-f140-4985-8fdc-dd117fc50527 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.487153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 926/1853] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:21:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:21:01.510814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] MFA Rules not processed for user `6b62d4e620bd40b98a2959bc028214f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:01.513843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:01.552212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.552509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.553325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.609718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:01.612390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:01.768447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 927/1854] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:21:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:01.773699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 928/1855] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:01.774994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:01.776890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:01.854145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:01.855652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:01.873463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedcdc1-7875-4488-833d-6f739c26970a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:01.878661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29abf76-664d-4c57-a1a3-d1b4c5f9d69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:01.879408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29abf76-664d-4c57-a1a3-d1b4c5f9d69c service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.879702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29abf76-664d-4c57-a1a3-d1b4c5f9d69c service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.880008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29abf76-664d-4c57-a1a3-d1b4c5f9d69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.895731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29abf76-664d-4c57-a1a3-d1b4c5f9d69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:01.898191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29abf76-664d-4c57-a1a3-d1b4c5f9d69c service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:01.911591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 928/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:01.973117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62382c-ee09-4a20-a856-5077b9b363f7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:01.978995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:01.980424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:01.980872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:01.981305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] PATH_INFO: `/v3/users/a67bcfd7020f48c1a0dfd2ba1bb5fc8d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:01.986619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67bcfd7020f48c1a0dfd2ba1bb5fc8d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:01.989807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:02.117601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67bcfd7020f48c1a0dfd2ba1bb5fc8d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:02.117601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67bcfd7020f48c1a0dfd2ba1bb5fc8d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:02.119862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67bcfd7020f48c1a0dfd2ba1bb5fc8d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:02.159093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67bcfd7020f48c1a0dfd2ba1bb5fc8d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:02.161351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:02.186817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67bcfd7020f48c1a0dfd2ba1bb5fc8d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:02.233727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:02.234985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:02.235660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:02.252683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 929/1857] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:01 2022] DELETE /identity/v3/users/a67bcfd7020f48c1a0dfd2ba1bb5fc8d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:02.279514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:02.281033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:02.362121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:02.379438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:02.381434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:02.468957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 929/1858] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:02.508072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:02.510112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:02.548047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55fb0-30ed-436a-9c69-8e40e4e5d5db admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:02.558934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:02.560898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:02.561926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:02.562558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:02.565472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:02.582504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:02.586910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:02.628279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 930/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:02.798723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d4ed9-cc06-480b-a10d-bc7b7927a5c6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:02.815099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:02.815817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:02.816137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:02.820891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:02.824556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:02.826289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:02.856077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:02.857771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:02.914071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a883-f790-4020-be17-30105db4cd88 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:02.921591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 930/1860] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:02.923345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:02.925260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:02.936910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:02.941588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:02.941588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:02.941588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] PATH_INFO: `/v3/users/18754deb5aa942f9873edb3bb4e82747` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:02.947937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18754deb5aa942f9873edb3bb4e82747)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:02.951009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:02.969123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346798-2b88-4af4-bcf8-cf40cad3ead7 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:02.975898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:02.977103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:02.977666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:02.978318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] PATH_INFO: `/v3/projects/30aecbd9eed04ad49d020572902d494f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:02.984788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30aecbd9eed04ad49d020572902d494f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:02.987816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:03.111871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18754deb5aa942f9873edb3bb4e82747'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.113657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18754deb5aa942f9873edb3bb4e82747'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.115519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18754deb5aa942f9873edb3bb4e82747'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.118290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30aecbd9eed04ad49d020572902d494f', 'request_id': 'req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.137185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30aecbd9eed04ad49d020572902d494f', 'request_id': 'req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.146068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18754deb5aa942f9873edb3bb4e82747'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.157330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30aecbd9eed04ad49d020572902d494f', 'request_id': 'req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.181331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b7718c14-e5b9-4764-9f27-cf7cf6598317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18754deb5aa942f9873edb3bb4e82747'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.184789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] The token cache is being invalidate because project 30aecbd9eed04ad49d020572902d494f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:03.185275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.187396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.193101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 931/1861] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:02 2022] DELETE /identity/v3/projects/30aecbd9eed04ad49d020572902d494f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:03.195203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:03.200522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.220987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 931/1862] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:02 2022] DELETE /identity/v3/users/18754deb5aa942f9873edb3bb4e82747 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:03.220987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc599-29c5-412b-8168-3434d1260d24 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.220987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc599-29c5-412b-8168-3434d1260d24 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.220987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc599-29c5-412b-8168-3434d1260d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.255273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9d3bc599-29c5-412b-8168-3434d1260d24 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:03.264757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9d3bc599-29c5-412b-8168-3434d1260d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.352624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:03.356800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5a3d-c52b-45bb-a659-edbdd1bd0fc6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:03.392528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:03.470839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:03.471620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.471996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.472464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] PATH_INFO: `/v3/users/9ced7858b9f5457c9a8139692efdb533` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.474175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ced7858b9f5457c9a8139692efdb533)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:03.477133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:03.484726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 932/1863] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:03.487063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b35a35-a13c-42d8-9f04-110f3c0b1db2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.488324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b35a35-a13c-42d8-9f04-110f3c0b1db2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.488843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b35a35-a13c-42d8-9f04-110f3c0b1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.546408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-89b35a35-a13c-42d8-9f04-110f3c0b1db2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:03.548380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-89b35a35-a13c-42d8-9f04-110f3c0b1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.572411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 933/1864] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:03.573679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.573967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.574247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.606233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ced7858b9f5457c9a8139692efdb533'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.629584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ced7858b9f5457c9a8139692efdb533'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.630073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:03.630414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ced7858b9f5457c9a8139692efdb533'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.632512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.646511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 934/1865] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:03.647638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:03.649993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.660048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ced7858b9f5457c9a8139692efdb533'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.677036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ced7858b9f5457c9a8139692efdb533'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:03.687546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 932/1866] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:03 2022] DELETE /identity/v3/users/9ced7858b9f5457c9a8139692efdb533 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:03.691109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:03.691109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.762045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd1dd3-adf0-4f5b-b3a9-8c4bf6bc1d70 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:03.821352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5985aa-08d6-4b7c-a33e-b8a304d8a842 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:03.828060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:03.829884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.829884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.829884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.830644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:03.831057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:03.841214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268814-ac64-474f-8039-ccd286a80392 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:03.850408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:03.851428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.851625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.851872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.853756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.863811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 933/1867] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:03.866494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.866998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.867645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.875406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:03.876939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:03.895344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 935/1868] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:03.896801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:03.909238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:03.909794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:03.920040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2ef1-a802-44aa-93d9-d7ae26069b3b service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:03.927584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 934/1869] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:03.933631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:03.934256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:03.934534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:03.934802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:03.935522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:03.948032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:03.989764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 936/1870] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:03 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:03.994115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.005834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d619675-abd7-42dd-a4cc-015932a3ab8d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.027918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:04.045479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.058600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:04.135992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.136808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.136928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.137177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.137989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.143007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.179283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575690-7e26-4927-8376-92d9fb71cf24 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.199652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.200309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 935/1871] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:03 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:04.201238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.202618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.202898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.203679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.228962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.230052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b23a-b93b-407b-990a-50b6abd31b37 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.232068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.245650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.246469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.246755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.247030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.250132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.255556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.263804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 937/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:04.275702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 936/1873] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:04.280456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.298002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cd04c-b120-4186-99af-b264231fc4ac service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.304797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60341c-fc98-47d9-9839-c595832b6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.305504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60341c-fc98-47d9-9839-c595832b6dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.305843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60341c-fc98-47d9-9839-c595832b6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.306399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60341c-fc98-47d9-9839-c595832b6dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.306905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60341c-fc98-47d9-9839-c595832b6dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.308870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60341c-fc98-47d9-9839-c595832b6dbd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.310612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:04.323086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 938/1874] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:04.327177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.339138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ffdb8-a347-4c40-9b06-69e19b8e55c8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.345049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.345879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.346384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.346671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] PATH_INFO: `/v3/projects/40df213cb8b84140ba227ade6c90ce5a/users/be341588b9e445cba3a6ec4f2364dd53/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.366998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40df213cb8b84140ba227ade6c90ce5a, user_id=be341588b9e445cba3a6ec4f2364dd53, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.370299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.388632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 937/1875] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:04 2022] PUT /identity/v3/projects/40df213cb8b84140ba227ade6c90ce5a/users/be341588b9e445cba3a6ec4f2364dd53/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:04.399341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.399642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.399905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.433261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] MFA Rules not processed for user `be341588b9e445cba3a6ec4f2364dd53`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:04.435223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:04.521541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.526369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 939/1876] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:04.596750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.598251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:04.677499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcfb9b-0802-4405-857a-c00895ea2482 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.688692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.689540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.690740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.691130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.693013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.696578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.752271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5a00f-fe44-4efb-a010-61b80ce89aa4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.759945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:04.760704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:04.761071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:04.761492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] PATH_INFO: `/v3/projects/fe8102f4dc0d4537a3473b074f9c5be2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:04.762753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8102f4dc0d4537a3473b074f9c5be2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:04.763684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 938/1877] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:04 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:04.765012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:04.767446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.858160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dadd89-f181-43bf-9209-6cec522548cb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:04.862581 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8102f4dc0d4537a3473b074f9c5be2', 'request_id': 'req-efc32a39-f236-4ba1-a37b-f08c997a46a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:04.863176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:04.881885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8102f4dc0d4537a3473b074f9c5be2', 'request_id': 'req-efc32a39-f236-4ba1-a37b-f08c997a46a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:04.904414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8102f4dc0d4537a3473b074f9c5be2', 'request_id': 'req-efc32a39-f236-4ba1-a37b-f08c997a46a9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:04.955618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] The token cache is being invalidate because project fe8102f4dc0d4537a3473b074f9c5be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:04.955931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:04.958122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:04.965634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 940/1878] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:04 2022] DELETE /identity/v3/projects/fe8102f4dc0d4537a3473b074f9c5be2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:04.967157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:04.969031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.003523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:05.021147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.021819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.022168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.022442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.023080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.025199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.075478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc32a39-f236-4ba1-a37b-f08c997a46a9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.081469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 939/1879] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:04 2022] POST /identity/v3/users => generated 300 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:05.081469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.084111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.084560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.085282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.085931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.085931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] PATH_INFO: `/v3/projects/8f8124b13faa418583b1bf26bcf3956b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.087482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8124b13faa418583b1bf26bcf3956b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.089956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.109380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899613-a977-4bd6-96dc-57631f066645 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.126067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.126794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.127026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.127306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] PATH_INFO: `/v3/users/6806dcb509e144ce844ff7fbe2726c2d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.129560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6806dcb509e144ce844ff7fbe2726c2d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.134364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.155476 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8124b13faa418583b1bf26bcf3956b', 'request_id': 'req-3eb7c53f-6766-44c6-a01c-7e0d37657127'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.164454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8124b13faa418583b1bf26bcf3956b', 'request_id': 'req-3eb7c53f-6766-44c6-a01c-7e0d37657127'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.173900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8124b13faa418583b1bf26bcf3956b', 'request_id': 'req-3eb7c53f-6766-44c6-a01c-7e0d37657127'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.188016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] The token cache is being invalidate because project 8f8124b13faa418583b1bf26bcf3956b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:05.188235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.188971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.190804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 941/1880] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:04 2022] DELETE /identity/v3/projects/8f8124b13faa418583b1bf26bcf3956b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:05.191452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.192832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.210722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6806dcb509e144ce844ff7fbe2726c2d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.220406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6806dcb509e144ce844ff7fbe2726c2d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.221349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6806dcb509e144ce844ff7fbe2726c2d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.250008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6806dcb509e144ce844ff7fbe2726c2d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.261958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6806dcb509e144ce844ff7fbe2726c2d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.268033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c53f-6766-44c6-a01c-7e0d37657127 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.271966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 940/1881] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:05 2022] DELETE /identity/v3/users/6806dcb509e144ce844ff7fbe2726c2d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:05.276266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.277166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.277447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.277826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.278549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.280832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.283463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.286258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.299139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 942/1882] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:05.300094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.302580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.317813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8df6d-fb54-4833-a735-541f711c79d2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.370151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:05.394295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.395259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.395879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.396336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] PATH_INFO: `/v3/users/8823169dc4eb4f1bb30c9d15afedd822` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.397761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8823169dc4eb4f1bb30c9d15afedd822)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.401826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.417683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15a7bc-34f7-44f6-af37-4b096efac637 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.432668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.433423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.433777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.434129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] PATH_INFO: `/v3/projects/53ae838f62034404ace3c775e32c09b9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.437561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ae838f62034404ace3c775e32c09b9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.441900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.472471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:05.480807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8823169dc4eb4f1bb30c9d15afedd822'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.481619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8823169dc4eb4f1bb30c9d15afedd822'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.482949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8823169dc4eb4f1bb30c9d15afedd822'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.498403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8823169dc4eb4f1bb30c9d15afedd822'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.507181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8823169dc4eb4f1bb30c9d15afedd822'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.535754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 943/1883] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:05 2022] DELETE /identity/v3/users/8823169dc4eb4f1bb30c9d15afedd822 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:05.536821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ae838f62034404ace3c775e32c09b9', 'request_id': 'req-1648c06e-a222-4185-a414-8d8003480ad2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.538085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.539704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.547947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ae838f62034404ace3c775e32c09b9', 'request_id': 'req-1648c06e-a222-4185-a414-8d8003480ad2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.563939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ae838f62034404ace3c775e32c09b9', 'request_id': 'req-1648c06e-a222-4185-a414-8d8003480ad2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.599208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] The token cache is being invalidate because project 53ae838f62034404ace3c775e32c09b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:05.599614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.602192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.605189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 941/1884] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:05 2022] DELETE /identity/v3/projects/53ae838f62034404ace3c775e32c09b9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:05.609796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.612038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.654718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd40a3-b9eb-444a-aa35-89e851026924 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.664931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.667667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.668409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.669076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] PATH_INFO: `/v3/projects/1ef15d5b2e0744b2a62e911b570a69c4/users/bd7a4df667634501993195f6aad6f5b9/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.698187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef15d5b2e0744b2a62e911b570a69c4, user_id=bd7a4df667634501993195f6aad6f5b9, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.701567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.719847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 944/1885] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:05 2022] PUT /identity/v3/projects/1ef15d5b2e0744b2a62e911b570a69c4/users/bd7a4df667634501993195f6aad6f5b9/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:05.724340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.727187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.740602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c06e-a222-4185-a414-8d8003480ad2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.810935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:05.838037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24bd6-7397-4e42-ba2e-e074d337ca8b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.844515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.845381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.845835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.846279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.847095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.849070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.856960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.858345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.858345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.858345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] PATH_INFO: `/v3/users/6b62d4e620bd40b98a2959bc028214f4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.861269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b62d4e620bd40b98a2959bc028214f4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.864167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.885762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 945/1886] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:05.886954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:05.899153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced00c6-bee8-45b0-bf3d-0a005d3fc539 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:05.904686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96735231-b215-4aab-a760-9f8e8250035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:05.905391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96735231-b215-4aab-a760-9f8e8250035c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.905717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96735231-b215-4aab-a760-9f8e8250035c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.905998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96735231-b215-4aab-a760-9f8e8250035c admin admin] PATH_INFO: `/v3/projects/1ef15d5b2e0744b2a62e911b570a69c4/users/bd7a4df667634501993195f6aad6f5b9/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.908128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96735231-b215-4aab-a760-9f8e8250035c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef15d5b2e0744b2a62e911b570a69c4, user_id=bd7a4df667634501993195f6aad6f5b9, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:05.912615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96735231-b215-4aab-a760-9f8e8250035c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:05.926189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 946/1887] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:05 2022] PUT /identity/v3/projects/1ef15d5b2e0744b2a62e911b570a69c4/users/bd7a4df667634501993195f6aad6f5b9/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:05.937865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:05.937865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:05.938120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:05.981424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] MFA Rules not processed for user `bd7a4df667634501993195f6aad6f5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:05.983300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b62d4e620bd40b98a2959bc028214f4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:05.983575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:05.997048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:06.028284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b62d4e620bd40b98a2959bc028214f4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.031366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b62d4e620bd40b98a2959bc028214f4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.095171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b62d4e620bd40b98a2959bc028214f4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.097261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 947/1888] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:06.107052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:06.108911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.134195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b62d4e620bd40b98a2959bc028214f4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.151146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 942/1889] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:05 2022] DELETE /identity/v3/users/6b62d4e620bd40b98a2959bc028214f4 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:06.188122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb8da-2b37-4557-a080-e47af5055186 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:06.263879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:06.264556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:06.264833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:06.265100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:06.268536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.306246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:06.358179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:06.361038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.369542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:06.371364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:06.386610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 948/1890] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:06.489477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:06.492216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.494450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7649dab-cf45-4f7b-a39b-5ed3d017693b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:06.501566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:06.502475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:06.502875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:06.503437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] PATH_INFO: `/v3/projects/45c8875da782400abad8825d6645d7ef` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:06.505000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c8875da782400abad8825d6645d7ef)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:06.509483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:06.519068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fefb4-7224-428f-824f-86842153731c service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:06.549525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:06.550292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:06.550468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:06.550744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] PATH_INFO: `/v3/projects/71b19058d101411bad60be948c0ce09d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:06.553510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b19058d101411bad60be948c0ce09d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:06.556183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:06.582685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c8875da782400abad8825d6645d7ef', 'request_id': 'req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.590885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c8875da782400abad8825d6645d7ef', 'request_id': 'req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.603277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c8875da782400abad8825d6645d7ef', 'request_id': 'req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.628246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] The token cache is being invalidate because project 45c8875da782400abad8825d6645d7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:06.628726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.630243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-11352fda-e7b7-4b1a-a6eb-82d19e5239fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.632523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 943/1891] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:06 2022] DELETE /identity/v3/projects/45c8875da782400abad8825d6645d7ef => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:06.637579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fdee4-0c56-47c9-aeb5-ec7bc4d69883 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:06.638120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fdee4-0c56-47c9-aeb5-ec7bc4d69883 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:06.638500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fdee4-0c56-47c9-aeb5-ec7bc4d69883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:06.663672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bb5fdee4-0c56-47c9-aeb5-ec7bc4d69883 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:06.665614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bb5fdee4-0c56-47c9-aeb5-ec7bc4d69883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.790137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:06.794890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b19058d101411bad60be948c0ce09d', 'request_id': 'req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.811848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b19058d101411bad60be948c0ce09d', 'request_id': 'req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.819549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 944/1892] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:06.828502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:06.829475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:06.829965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:06.831362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b19058d101411bad60be948c0ce09d', 'request_id': 'req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.858189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:06.859899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.862447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] The token cache is being invalidate because project 71b19058d101411bad60be948c0ce09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:06.863926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.865796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c48e5a55-a3f6-4ae6-972b-afc0386f0f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:06.870742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 949/1893] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:06 2022] DELETE /identity/v3/projects/71b19058d101411bad60be948c0ce09d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:06.874574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde993cd-66be-4352-8999-83827a54950d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:06.874856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde993cd-66be-4352-8999-83827a54950d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:06.875734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde993cd-66be-4352-8999-83827a54950d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:06.929419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dde993cd-66be-4352-8999-83827a54950d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:06.930552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dde993cd-66be-4352-8999-83827a54950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.970575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 945/1894] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:06.975025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:06.978671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:06.993452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525c23b-cb05-4c86-bfdb-4fc5f4a6d2b9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:06.998762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.000200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.000477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.000753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] PATH_INFO: `/v3/projects/3c8951b6136f406ca92274c0139a04f4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.002212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8951b6136f406ca92274c0139a04f4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.005510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.020131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 950/1895] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:07.020131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde993cd-66be-4352-8999-83827a54950d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.027644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde993cd-66be-4352-8999-83827a54950d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.034425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.035183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.035539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.035907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.037258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:07.037644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.039721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d4371-2eaa-4bab-9143-8ecd4bccccd0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.062302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 951/1896] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:07.062302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ea2da-3291-4d79-96a6-42940256e7c2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.062302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ea2da-3291-4d79-96a6-42940256e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.062302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ea2da-3291-4d79-96a6-42940256e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.087402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0e7ea2da-3291-4d79-96a6-42940256e7c2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:07.088647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0e7ea2da-3291-4d79-96a6-42940256e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.105903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8951b6136f406ca92274c0139a04f4', 'request_id': 'req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.117911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:07.118807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8951b6136f406ca92274c0139a04f4', 'request_id': 'req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.132026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8951b6136f406ca92274c0139a04f4', 'request_id': 'req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.146070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] The token cache is being invalidate because project 3c8951b6136f406ca92274c0139a04f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:07.146385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.147255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.149014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 946/1897] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:06 2022] DELETE /identity/v3/projects/3c8951b6136f406ca92274c0139a04f4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:07.150168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.151150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.182902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 952/1898] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:07.184130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.184416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.184691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.209922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:07.211214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.221372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 953/1899] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:07.222470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.234489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364ad1-661b-46f0-b2bf-9d808deb90e6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.239290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.241023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.241023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.241275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.241935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:07.242240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.244048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba0f2e-16bd-4632-9c17-9c044fa072cd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.245719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3a4f-ab6b-44f9-9bbe-773dba92f0aa admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.251124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.251998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.252418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.252849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.253642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.255560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.259435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 954/1900] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:07.260644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.260918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.261248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.281549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:07.282794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.291679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 955/1901] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:07.292552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.300539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 947/1902] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:07.300539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.304971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8aac-d936-4d86-b8c4-a2437d08acab None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.312140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:07.372578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.373220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.373509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.373791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.374617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.374788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fda676-483c-4f62-8e3b-8ecb0d5b1059 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.376466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.379944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.380839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.381703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.382071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.382809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:07.383179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.384949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.397775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 948/1903] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:07.398817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.412018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 956/1904] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:07.412198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882d6d9-c2e1-4acc-8a91-0dd4fb73a97c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.412293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.412293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.483209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea59a51-21b8-43fd-bf7e-a8cb56ef8809 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.488797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.489570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.490014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.490798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.491174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.491290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.491515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.491839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] PATH_INFO: `/v3/users/be341588b9e445cba3a6ec4f2364dd53` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.492591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.493062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be341588b9e445cba3a6ec4f2364dd53)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.495036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.495495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.530898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 949/1905] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:07.530898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.538509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:07.545946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695f8b3-a295-4abb-9701-6d68d78e7e9f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.553544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.554420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.555228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.555686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.557556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.561130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.561621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be341588b9e445cba3a6ec4f2364dd53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.562620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be341588b9e445cba3a6ec4f2364dd53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.563604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be341588b9e445cba3a6ec4f2364dd53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.585052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be341588b9e445cba3a6ec4f2364dd53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.606636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be341588b9e445cba3a6ec4f2364dd53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:07.625985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 957/1906] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:07 2022] DELETE /identity/v3/users/be341588b9e445cba3a6ec4f2364dd53 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:07.625985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.627751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.635529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 950/1907] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:07.636869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.641877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.740757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40a4ed-a1b3-41bd-8c45-b8742c037f76 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.753189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65055bf-7bc7-4411-865d-dbd2f367359c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.754865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.755582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.756913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.757223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.758925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.761589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.766265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e11d3-4c2c-4263-8540-98803bb44b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.766984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e11d3-4c2c-4263-8540-98803bb44b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.767265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e11d3-4c2c-4263-8540-98803bb44b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.767666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e11d3-4c2c-4263-8540-98803bb44b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.768482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e11d3-4c2c-4263-8540-98803bb44b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.770583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e11d3-4c2c-4263-8540-98803bb44b97 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.794689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 951/1908] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:07.794689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7a37-c628-427c-b71b-5009d870636d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.794689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7a37-c628-427c-b71b-5009d870636d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.795037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7a37-c628-427c-b71b-5009d870636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.808350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 958/1909] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:07.809839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.814650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:07.816139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.847047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69797-9a20-4bf0-8c79-3c61cbd6ce15 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.857586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-536f7a37-c628-427c-b71b-5009d870636d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:07.858835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-536f7a37-c628-427c-b71b-5009d870636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:07.868714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.870388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.870887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.871375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.873150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.874602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 952/1910] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:07.875450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7a37-c628-427c-b71b-5009d870636d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.878838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.912621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7a37-c628-427c-b71b-5009d870636d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.914750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.915383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.915660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.915929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.924935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.927193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.946708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 953/1911] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:07.950470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.967124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 959/1912] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:07 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:07.977077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289095f0-c169-4bc1-8d58-521c9890f417 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:07.985237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:07.987147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:07.987790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:07.989003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:07.989287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:07.989942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:07.992154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:07.998120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:08.022704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 954/1913] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:08.023362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.054073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bebdd6-ffb8-4729-91e4-975bcddc842f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.071796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.072608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.072920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.073189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] PATH_INFO: `/v3/projects/050dd1a9637648c1b0f18565cf9459f7/users/a589cef77a7e49718d077e304cdaeee3/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.101543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=050dd1a9637648c1b0f18565cf9459f7, user_id=a589cef77a7e49718d077e304cdaeee3, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.105304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.131696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 955/1914] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:08 2022] PUT /identity/v3/projects/050dd1a9637648c1b0f18565cf9459f7/users/a589cef77a7e49718d077e304cdaeee3/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:08.143320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.163103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516926d-3b07-4e2a-b9f0-7f23c3acd142 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.232509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:INSERT=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:08.284159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.284784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.285062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.285330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.296208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe78a9-a555-43d9-8bb3-a2c0150ce60a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.300121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.302249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.311662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7083f-d888-4c11-8f89-ab48b772d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.312577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7083f-d888-4c11-8f89-ab48b772d470 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.313020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7083f-d888-4c11-8f89-ab48b772d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.313446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7083f-d888-4c11-8f89-ab48b772d470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.314248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7083f-d888-4c11-8f89-ab48b772d470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.315197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 960/1915] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:08.316067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.318132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7083f-d888-4c11-8f89-ab48b772d470 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.329025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dacdb6-15ba-4476-b7d8-94e24df7b8ed service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.335000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.335747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.336053 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.336328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.336975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.338576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.343263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 956/1916] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:08.346102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.346565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.350457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.352028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 961/1917] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:08.352885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.382801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] MFA Rules not processed for user `a589cef77a7e49718d077e304cdaeee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:08.384487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:08.389144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67305d58-9cb0-4db8-bedb-3b6fc7a06125 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.402757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.403834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.404284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.404907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.405344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.407173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.441056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 962/1918] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:08.444765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.469477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 957/1919] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:08.470515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.486298 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7694e-e2ef-4fef-aa43-325f4f7e5111 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.491607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7deb4-6270-45b6-8f39-836cb7ffa2e2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.498416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.499113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.499755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.499999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] PATH_INFO: `/v3/projects/0a763182e3764541a8a1e56f0e7354fc/users/b2285e79530340578f1db602f79e464d/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.501733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836f8f2-0d43-4437-a3eb-a89c860b9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.503863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f8f2-0d43-4437-a3eb-a89c860b9c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.506428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f8f2-0d43-4437-a3eb-a89c860b9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.507237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f8f2-0d43-4437-a3eb-a89c860b9c2c admin admin] PATH_INFO: `/v3/projects/0091e933feec4e37b292f8071ead0308/users/5ffc9fe0a4f94e17ae039abe33a05510/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.520070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a763182e3764541a8a1e56f0e7354fc, user_id=b2285e79530340578f1db602f79e464d, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.523589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.542649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 958/1920] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:08 2022] PUT /identity/v3/projects/0a763182e3764541a8a1e56f0e7354fc/users/b2285e79530340578f1db602f79e464d/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:08.543767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.554102 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836f8f2-0d43-4437-a3eb-a89c860b9c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0091e933feec4e37b292f8071ead0308, user_id=5ffc9fe0a4f94e17ae039abe33a05510, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.561619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836f8f2-0d43-4437-a3eb-a89c860b9c2c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.567981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:08.594027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 963/1921] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:08 2022] PUT /identity/v3/projects/0091e933feec4e37b292f8071ead0308/users/5ffc9fe0a4f94e17ae039abe33a05510/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:08.596360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce7d-bebc-4ed4-8cb3-6d1bc3e67cec None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.596987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce7d-bebc-4ed4-8cb3-6d1bc3e67cec None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.598230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce7d-bebc-4ed4-8cb3-6d1bc3e67cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.647419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-75ecce7d-bebc-4ed4-8cb3-6d1bc3e67cec None None] MFA Rules not processed for user `b2285e79530340578f1db602f79e464d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:08.648901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75ecce7d-bebc-4ed4-8cb3-6d1bc3e67cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:08.661790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cead6-aa68-45e0-95a1-c47857875033 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.726974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 964/1922] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:08.728280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.728571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.728854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.761055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.761767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.762095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.762489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.763189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.765250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.768857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] MFA Rules not processed for user `5ffc9fe0a4f94e17ae039abe33a05510`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:08.770940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:08.814550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 959/1923] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/projects => generated 381 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:08.814550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.859131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 965/1924] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:08.860130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.872202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9476-abdd-47b5-ba33-462b0c0ea682 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.881644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:08.896284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9ef2-2931-4ef7-96a2-e76539231726 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:08.901847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.902594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.902879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.903147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.903770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.905727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:08.943976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 960/1925] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:08.945158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:08.949086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:08.949762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:08.950345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:08.950666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:08.951304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:08.953826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.014733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 966/1926] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:09.014733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.015844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:09.017844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.038657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5e1b2-4a95-4bd9-aba0-2f86a7b8fd7e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.070832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4b29-c833-4485-bcd3-cb50fe2372e8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.079269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.080108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.080443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.080726 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.081725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.083624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.119780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 961/1927] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:08 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:09.121539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.176032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.176714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.176995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.177263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] PATH_INFO: `/v3/projects/40df213cb8b84140ba227ade6c90ce5a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.178999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40df213cb8b84140ba227ade6c90ce5a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.181589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.210216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb835cb-1b8e-4b06-b3a8-6236e924464f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.219836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.220542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.221338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.221630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.222383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.225848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.255683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 962/1928] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:09 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:09.256745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.269374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40df213cb8b84140ba227ade6c90ce5a', 'request_id': 'req-3724522c-052c-4d01-8c92-1dcbaa2500e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.281097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047bc0-d7a6-4e3c-9002-56b30e86e03e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.283323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40df213cb8b84140ba227ade6c90ce5a', 'request_id': 'req-3724522c-052c-4d01-8c92-1dcbaa2500e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.297105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40df213cb8b84140ba227ade6c90ce5a', 'request_id': 'req-3724522c-052c-4d01-8c92-1dcbaa2500e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.320791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] The token cache is being invalidate because project 40df213cb8b84140ba227ade6c90ce5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:09.321094 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.324398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.327060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 967/1929] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:09 2022] DELETE /identity/v3/projects/40df213cb8b84140ba227ade6c90ce5a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:09.327552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.330971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.388671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.389790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.390255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.390701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.391672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.393718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.403726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:09.411107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 963/1930] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:09.414049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.418176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.446115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724522c-052c-4d01-8c92-1dcbaa2500e6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.452505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.453129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.453404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.453674 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.454296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.454640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd96aed-fef0-48cd-87d8-4c068c0e0f58 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.456740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.461434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.463055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.463499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.463932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.465048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.467806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.482460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 964/1931] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:09.483931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.491618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.504377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 968/1932] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:09 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:09.505782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.513168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.522287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae97da1-104f-41f7-a3e1-1d866ae9a7b3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.527294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.528840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.529260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.529542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] PATH_INFO: `/v3/users/bd7a4df667634501993195f6aad6f5b9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.530728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7a4df667634501993195f6aad6f5b9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.534491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.544813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb44b-6c3f-4b70-a1e9-6abb057203bd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.561999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.564340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.564789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.565210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] PATH_INFO: `/v3/projects/c315544eac654c4bb46744ec4a0d0d49/users/576c68b824934ee79db7820e58ef16c8/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.575738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:09.592504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c315544eac654c4bb46744ec4a0d0d49, user_id=576c68b824934ee79db7820e58ef16c8, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.595644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.607907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7a4df667634501993195f6aad6f5b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.618614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7a4df667634501993195f6aad6f5b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.619639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7a4df667634501993195f6aad6f5b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.628149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 969/1933] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:09 2022] PUT /identity/v3/projects/c315544eac654c4bb46744ec4a0d0d49/users/576c68b824934ee79db7820e58ef16c8/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:09.635662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.639532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7a4df667634501993195f6aad6f5b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.663988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7a4df667634501993195f6aad6f5b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:09.667909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 965/1934] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:09 2022] DELETE /identity/v3/users/bd7a4df667634501993195f6aad6f5b9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:09.669014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.673585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.763581 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee037-2c17-472d-8323-8aebc639aca0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.784297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100751-69b8-4f95-839c-2eedc0d5aa99 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.791107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.792385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.792677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.793063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.794181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.796759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.820066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 966/1935] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:09.821295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.827323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.841503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.842263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.842612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.844160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] PATH_INFO: `/v3/projects/2d00b2e6061c41c096ac126186cfce47/users/3c95dbd5127048b68d755c02c5655eec/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.847461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc39e-f9fb-45e9-9a5b-7d6eab727ca6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.856369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.858443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.858731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.859009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.860367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.865633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.883382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 967/1936] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:09.884295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.885392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d00b2e6061c41c096ac126186cfce47, user_id=3c95dbd5127048b68d755c02c5655eec, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.893088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.901028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25fc6c-2058-4a1f-b1ab-f55bf566e2f9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:09.907879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:09.909368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:09.909924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:09.910438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] PATH_INFO: `/v3/projects/7993d017185140a8a3adb03d6466c144/users/ee1e0cdcbf19446dbbc21acbeea07864/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:09.933268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7993d017185140a8a3adb03d6466c144, user_id=ee1e0cdcbf19446dbbc21acbeea07864, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:09.934602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 970/1937] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:09 2022] PUT /identity/v3/projects/2d00b2e6061c41c096ac126186cfce47/users/3c95dbd5127048b68d755c02c5655eec/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:09.935797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.941003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:09.961554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 968/1938] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:09 2022] PUT /identity/v3/projects/7993d017185140a8a3adb03d6466c144/users/ee1e0cdcbf19446dbbc21acbeea07864/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:09.962778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:09.966655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:09.985971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:10.050627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327b21a-9357-4400-9619-b8dfae645f0c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.126299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fcadb-82bd-4fba-8840-330671886246 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.148652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.149299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.149582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.149854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.151499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.155324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.164570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:10.201234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 969/1939] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:10.201749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:10.212177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.213070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.213070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.213280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] PATH_INFO: `/v3/projects/c315544eac654c4bb46744ec4a0d0d49/users/576c68b824934ee79db7820e58ef16c8/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.217717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c315544eac654c4bb46744ec4a0d0d49, user_id=576c68b824934ee79db7820e58ef16c8, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.223193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.230895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233928a9-7521-4dba-942a-6882e675e30b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.243659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6f26-e940-4432-bd1f-206530bdd27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.244317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6f26-e940-4432-bd1f-206530bdd27c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.244599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6f26-e940-4432-bd1f-206530bdd27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.244873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6f26-e940-4432-bd1f-206530bdd27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.245531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc6f26-e940-4432-bd1f-206530bdd27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.250663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 971/1940] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:09 2022] PUT /identity/v3/projects/c315544eac654c4bb46744ec4a0d0d49/users/576c68b824934ee79db7820e58ef16c8/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:10.251503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:10.252567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc6f26-e940-4432-bd1f-206530bdd27c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.283119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 970/1941] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:10.286884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.287629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.287908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.372595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] MFA Rules not processed for user `576c68b824934ee79db7820e58ef16c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:10.373820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.421573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ebdfc-7ebd-4b35-9a1a-22433b57483e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.431100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.432189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.432735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.433244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] PATH_INFO: `/v3/projects/2d00b2e6061c41c096ac126186cfce47/users/3c95dbd5127048b68d755c02c5655eec/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.438124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d00b2e6061c41c096ac126186cfce47, user_id=3c95dbd5127048b68d755c02c5655eec, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.442683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.469722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 972/1942] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:10 2022] PUT /identity/v3/projects/2d00b2e6061c41c096ac126186cfce47/users/3c95dbd5127048b68d755c02c5655eec/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:10.470984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:10.498244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 971/1943] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:10.499544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:10.501347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.521800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe98f4-3a10-43fc-bc04-b9a6b8ad58dc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.572594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cc920-a295-4633-9afd-a80d6ff10cf5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.578675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af70334-5b7a-444c-b6b1-ca8a764ae332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.579561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70334-5b7a-444c-b6b1-ca8a764ae332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.579923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70334-5b7a-444c-b6b1-ca8a764ae332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.580296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70334-5b7a-444c-b6b1-ca8a764ae332 admin admin] PATH_INFO: `/v3/projects/7993d017185140a8a3adb03d6466c144/users/ee1e0cdcbf19446dbbc21acbeea07864/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.582677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70334-5b7a-444c-b6b1-ca8a764ae332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7993d017185140a8a3adb03d6466c144, user_id=ee1e0cdcbf19446dbbc21acbeea07864, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.587304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70334-5b7a-444c-b6b1-ca8a764ae332 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.591929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:10.595895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.597414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.597899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.598792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] PATH_INFO: `/v3/projects/1ef15d5b2e0744b2a62e911b570a69c4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.601119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef15d5b2e0744b2a62e911b570a69c4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.603256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.604992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 973/1944] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:10 2022] PUT /identity/v3/projects/7993d017185140a8a3adb03d6466c144/users/ee1e0cdcbf19446dbbc21acbeea07864/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:10.607603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b727a-4cca-4aeb-910e-03d9fa3ca44d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.607894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b727a-4cca-4aeb-910e-03d9fa3ca44d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.608777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b727a-4cca-4aeb-910e-03d9fa3ca44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.645286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-052b727a-4cca-4aeb-910e-03d9fa3ca44d None None] MFA Rules not processed for user `3c95dbd5127048b68d755c02c5655eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:10.646928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-052b727a-4cca-4aeb-910e-03d9fa3ca44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.668688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef15d5b2e0744b2a62e911b570a69c4', 'request_id': 'req-8de9ff65-5e59-47c5-bea4-f60a27e06677'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:10.694869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef15d5b2e0744b2a62e911b570a69c4', 'request_id': 'req-8de9ff65-5e59-47c5-bea4-f60a27e06677'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:10.710819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef15d5b2e0744b2a62e911b570a69c4', 'request_id': 'req-8de9ff65-5e59-47c5-bea4-f60a27e06677'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:10.732505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] The token cache is being invalidate because project 1ef15d5b2e0744b2a62e911b570a69c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:10.733367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:10.734159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:10.736759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 972/1945] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:10 2022] DELETE /identity/v3/projects/1ef15d5b2e0744b2a62e911b570a69c4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:10.737583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:10.739246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.740857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 974/1946] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:10.742362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2d11-6c63-4b14-874d-ec1e7e2459d0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.742762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2d11-6c63-4b14-874d-ec1e7e2459d0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.743565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2d11-6c63-4b14-874d-ec1e7e2459d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.748196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:10.778265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ae7f2d11-6c63-4b14-874d-ec1e7e2459d0 None None] MFA Rules not processed for user `ee1e0cdcbf19446dbbc21acbeea07864`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:10.779640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae7f2d11-6c63-4b14-874d-ec1e7e2459d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.847553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ff65-5e59-47c5-bea4-f60a27e06677 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.852415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.853036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.853319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.853594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.855384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.875160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 975/1947] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:10.875160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a52e1-7971-4055-92a9-4c902efed7bc None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.875160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a52e1-7971-4055-92a9-4c902efed7bc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.875160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a52e1-7971-4055-92a9-4c902efed7bc None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.875160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 976/1948] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:21:10.876652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade474-7fe8-4392-b7af-2542cc4766d4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.877032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade474-7fe8-4392-b7af-2542cc4766d4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.877400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade474-7fe8-4392-b7af-2542cc4766d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.901421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a2ade474-7fe8-4392-b7af-2542cc4766d4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:10.902663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a2ade474-7fe8-4392-b7af-2542cc4766d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.945577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:10.947039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:10.957666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 973/1949] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:10.958396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:10.960305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.975440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ebe12-0dc8-449f-9f7c-ab7529c2bb2f service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:10.980609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:10.981222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.981511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.981947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:10.984064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:10.989891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 977/1950] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:10.992150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:10.992490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:10.992767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.014185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:11.021787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:11.023442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:11.084292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.085760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2aea-9f74-41e9-a4ee-a13e786e8cdd service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.097235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 974/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:11.098581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.098988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.099335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.108496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 978/1952] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:11.111543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.123004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94d8e-03cc-404c-889a-ee231416fb28 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.127542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:11.128037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.129011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.129416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.129713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.131541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:11.143052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.144542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.146298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 975/1953] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:11.150051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.152130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:11.157776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 979/1954] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:11.160251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.169929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a72ceb-53c5-4e11-a5a9-93ab0155a9b0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.175472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7f77d-229e-4c6b-858a-0d60fd41fab9 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.178057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.178877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.179340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.179760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.183011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.184234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.184585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.184854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.185693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:11.186019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.188482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.194339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.196772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.212639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 976/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:11.220335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.224765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 980/1956] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:11.237429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ba90-6749-416d-a727-2bdbfff9acd4 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.241978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.242448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.242731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.243005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.245075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:11.257883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.275754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6da23-9d63-44b8-a597-fda98a7d5afb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.279977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:11.284215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.285060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.285445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.285821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.287179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.289401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.325321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 981/1957] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:11 2022] POST /identity/v3/projects => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:11.329445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.330702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.332364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.342949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 977/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:11.491856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1919a-f19e-4f52-a051-4deef66c74f3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.498237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.498659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.498940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.499212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.499842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.501904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.563595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 982/1959] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:11 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:11.567317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.587761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1c27-1c64-422d-aad5-afa74458de2f service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.603250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.604041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.604300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.604513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.605147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.607094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.632262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 978/1960] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:11.635415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.651070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e93922-379e-4785-ab26-3adf5ff250f3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.663898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f2f1-f918-4d73-843c-fa11e4be44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.664573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f2f1-f918-4d73-843c-fa11e4be44fb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.664858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f2f1-f918-4d73-843c-fa11e4be44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.667470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f2f1-f918-4d73-843c-fa11e4be44fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.668200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f2f1-f918-4d73-843c-fa11e4be44fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.672770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f2f1-f918-4d73-843c-fa11e4be44fb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.688591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 983/1961] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:11.693375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.714252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597b815-8a6d-43f6-b97a-60e042c73c85 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:11.722036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:11.722987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.723596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.724084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] PATH_INFO: `/v3/projects/a3d16319ba984cd7b1ae98154a89fb36/users/d0b149df39d643fc84b6d6e43cab59b5/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.755684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d16319ba984cd7b1ae98154a89fb36, user_id=d0b149df39d643fc84b6d6e43cab59b5, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:11.758166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:11.782735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 979/1962] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:11 2022] PUT /identity/v3/projects/a3d16319ba984cd7b1ae98154a89fb36/users/d0b149df39d643fc84b6d6e43cab59b5/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:11.792856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:11.793153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:11.793457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:11.824395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] MFA Rules not processed for user `d0b149df39d643fc84b6d6e43cab59b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:11.825703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:11.846480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:11.897641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:11.899716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:11.939084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 984/1963] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:11.983001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:12.019288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4e1f-3189-4c15-bb4c-d9f157fda666 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.026531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.027555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.028085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.028528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] PATH_INFO: `/v3/users/a589cef77a7e49718d077e304cdaeee3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.030005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a589cef77a7e49718d077e304cdaeee3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.033117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.060853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28918fd1-4569-43b9-9060-cac729a1ebf7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.064898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.065702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.066035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.066538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.079323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.081584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.097438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 985/1964] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:12.098312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:12.101107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.111936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a589cef77a7e49718d077e304cdaeee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.121271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a589cef77a7e49718d077e304cdaeee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.122029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a589cef77a7e49718d077e304cdaeee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.126661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b17ee-b728-4208-8160-04e65aa2f474 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.133878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.134870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.135376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.136044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] PATH_INFO: `/v3/users/5ffc9fe0a4f94e17ae039abe33a05510` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.138212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a589cef77a7e49718d077e304cdaeee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.138824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffc9fe0a4f94e17ae039abe33a05510)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.141346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.148426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a589cef77a7e49718d077e304cdaeee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.160528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 980/1965] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:11 2022] DELETE /identity/v3/users/a589cef77a7e49718d077e304cdaeee3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:12.160528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:12.160528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.177946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:12.224552 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffc9fe0a4f94e17ae039abe33a05510'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.225748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffc9fe0a4f94e17ae039abe33a05510'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.227837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffc9fe0a4f94e17ae039abe33a05510'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.261141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be06ffb-54a0-4605-8dfd-9fef13e65560 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.262286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffc9fe0a4f94e17ae039abe33a05510'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.274707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.275453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.275810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.276188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] PATH_INFO: `/v3/users/d0b149df39d643fc84b6d6e43cab59b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.277497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b149df39d643fc84b6d6e43cab59b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.279658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.280750 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9258eeb1-f2a1-4fe1-9095-13a8fcc4db94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffc9fe0a4f94e17ae039abe33a05510'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.301536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 986/1966] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:12 2022] DELETE /identity/v3/users/5ffc9fe0a4f94e17ae039abe33a05510 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:12.301536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03ab4f-ebe6-4eaa-baac-aa11b80b035f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.301536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03ab4f-ebe6-4eaa-baac-aa11b80b035f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.301536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03ab4f-ebe6-4eaa-baac-aa11b80b035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.322689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fc03ab4f-ebe6-4eaa-baac-aa11b80b035f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:12.324612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc03ab4f-ebe6-4eaa-baac-aa11b80b035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.370237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b149df39d643fc84b6d6e43cab59b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.375534 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:12.383477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b149df39d643fc84b6d6e43cab59b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.385829 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b149df39d643fc84b6d6e43cab59b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.420936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 987/1967] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:12.420936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8926-23be-414b-a4aa-944e8f5624a0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.420936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8926-23be-414b-a4aa-944e8f5624a0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.420936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8926-23be-414b-a4aa-944e8f5624a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.425377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b149df39d643fc84b6d6e43cab59b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.438881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b149df39d643fc84b6d6e43cab59b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:12.448864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 981/1968] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:12 2022] DELETE /identity/v3/users/d0b149df39d643fc84b6d6e43cab59b5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:12.448864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:12.449790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-635b8926-23be-414b-a4aa-944e8f5624a0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:12.449976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.450247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-635b8926-23be-414b-a4aa-944e8f5624a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.536392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 988/1969] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:12.537037 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.537324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.537919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.546719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6533a2-cddd-4335-8c50-2a8661cebfea admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.558277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.558904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.559184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.559510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.561325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.564729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:12.565995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.576093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 989/1970] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:12.576255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.576353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:12.577168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.587325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 982/1971] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:12.588200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:12.589380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682bebb-b021-499f-ada7-90efe9d5d86a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.589502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:12.593075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.593696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.593979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.594253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.601949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994453-a651-48a1-a4aa-78509183b99a service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:12.606974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:12.606974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:12.606974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:12.607621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:12.617786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.620050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.628323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:12.629807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:12.632000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 983/1972] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:12.649969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 990/1973] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:13.152097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.153568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.182851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3c63-b084-4ff4-94e4-31ecc269c409 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.192717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.194481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.195079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.195614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] PATH_INFO: `/v3/projects/050dd1a9637648c1b0f18565cf9459f7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.198436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=050dd1a9637648c1b0f18565cf9459f7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.200824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.201366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.203703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.222793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd9f5-9815-46ad-8590-66ff1c6729eb service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.225990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:13.230116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.230792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.231082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.231312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] PATH_INFO: `/v3/projects/a3d16319ba984cd7b1ae98154a89fb36` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.232567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d16319ba984cd7b1ae98154a89fb36)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.234586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.279396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050dd1a9637648c1b0f18565cf9459f7', 'request_id': 'req-0ff33610-5159-4a92-991c-496ac85df56f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.292146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050dd1a9637648c1b0f18565cf9459f7', 'request_id': 'req-0ff33610-5159-4a92-991c-496ac85df56f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.307871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050dd1a9637648c1b0f18565cf9459f7', 'request_id': 'req-0ff33610-5159-4a92-991c-496ac85df56f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.325720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] The token cache is being invalidate because project 050dd1a9637648c1b0f18565cf9459f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:13.326095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.326849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.329239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 984/1974] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:13 2022] DELETE /identity/v3/projects/050dd1a9637648c1b0f18565cf9459f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:13.330131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.331597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.350305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d16319ba984cd7b1ae98154a89fb36', 'request_id': 'req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.371668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d16319ba984cd7b1ae98154a89fb36', 'request_id': 'req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.384587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d16319ba984cd7b1ae98154a89fb36', 'request_id': 'req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.400768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] The token cache is being invalidate because project a3d16319ba984cd7b1ae98154a89fb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:13.401211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.401991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.404627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 991/1975] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:13 2022] DELETE /identity/v3/projects/a3d16319ba984cd7b1ae98154a89fb36 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:13.405610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.407021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.448828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33610-5159-4a92-991c-496ac85df56f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.487563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:13.529561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a07b-c84d-49a5-b4c9-fcd6464bebed admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.535600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.536297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.536662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.536939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] PATH_INFO: `/v3/users/576c68b824934ee79db7820e58ef16c8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.538380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=576c68b824934ee79db7820e58ef16c8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.540703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.562675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.567181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.567486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.568327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] PATH_INFO: `/v3/projects/0091e933feec4e37b292f8071ead0308` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.569690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0091e933feec4e37b292f8071ead0308)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.571677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.623158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576c68b824934ee79db7820e58ef16c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.624118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576c68b824934ee79db7820e58ef16c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.624955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576c68b824934ee79db7820e58ef16c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.643562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576c68b824934ee79db7820e58ef16c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.648382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0091e933feec4e37b292f8071ead0308', 'request_id': 'req-e2d32d6c-08be-4de1-9534-5c7233cb88e4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.651623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:13.658610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0091e933feec4e37b292f8071ead0308', 'request_id': 'req-e2d32d6c-08be-4de1-9534-5c7233cb88e4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.659827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2c60fff9-141a-4949-b74f-da418318f2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576c68b824934ee79db7820e58ef16c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.668965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0091e933feec4e37b292f8071ead0308', 'request_id': 'req-e2d32d6c-08be-4de1-9534-5c7233cb88e4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.680002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 992/1976] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:13 2022] DELETE /identity/v3/users/576c68b824934ee79db7820e58ef16c8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:13.680976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c0c2-f7d4-4c7e-9291-06e9557c3a09 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.681256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c0c2-f7d4-4c7e-9291-06e9557c3a09 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.684347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c0c2-f7d4-4c7e-9291-06e9557c3a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.686954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] The token cache is being invalidate because project 0091e933feec4e37b292f8071ead0308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:13.687249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.687923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.689478 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 985/1977] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:13 2022] DELETE /identity/v3/projects/0091e933feec4e37b292f8071ead0308 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:13.694090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.695620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.705627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-68d0c0c2-f7d4-4c7e-9291-06e9557c3a09 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:13.706985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-68d0c0c2-f7d4-4c7e-9291-06e9557c3a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.783890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 993/1978] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:13.793939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.794224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.794499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.811025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d32d6c-08be-4de1-9534-5c7233cb88e4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.820269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.821007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.823999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.824719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] PATH_INFO: `/v3/users/ee1e0cdcbf19446dbbc21acbeea07864` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.825999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:13.826905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1e0cdcbf19446dbbc21acbeea07864)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.827189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:13.830627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.841610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 994/1979] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:13.842564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.853737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422030-8fc6-4514-b0ce-45a3027decfa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.858919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.859545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.859875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.860177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.862096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:13.862639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.864564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.898163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 995/1980] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:13.902616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:13.927747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1e0cdcbf19446dbbc21acbeea07864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.936420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d25dd6-32c3-4875-9583-53f1e8042c3f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:13.945660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:13.946754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:13.947215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:13.956899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1e0cdcbf19446dbbc21acbeea07864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.958645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:13.958993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1e0cdcbf19446dbbc21acbeea07864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:13.961054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:13.964715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:13.994079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1e0cdcbf19446dbbc21acbeea07864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.011329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 996/1981] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:14.012486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.014933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1e0cdcbf19446dbbc21acbeea07864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.029722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 986/1982] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:13 2022] DELETE /identity/v3/users/ee1e0cdcbf19446dbbc21acbeea07864 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:14.033831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:14.148387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a02c90-9069-43de-8faf-2ac52b6ec6d9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.247465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.247465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.247465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.247465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.247815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.251615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.280386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 997/1983] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:14 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:14.282201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.284126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.294501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.299238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.301422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148496-8f50-4f98-b5b2-e5c54d797c21 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.308425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.308425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.308425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.308741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.309441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.311417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.329624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 987/1984] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:14.330748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.336940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263acf6-f48a-4be7-ba05-97369588a842 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.344875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26914862-d315-45fb-afe4-d7b11b394294 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.347491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.349955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.350453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.351003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] PATH_INFO: `/v3/projects/c315544eac654c4bb46744ec4a0d0d49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.351575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.352304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.352671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.353021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.354023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c315544eac654c4bb46744ec4a0d0d49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.354409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.356387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.357358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.388847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 988/1985] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:14.393420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.404688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c698c7-5d99-4892-b24a-4facd6715ee2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.410487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e85eb-60da-4a25-9d57-c075dbfa5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.411292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e85eb-60da-4a25-9d57-c075dbfa5aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.412269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e85eb-60da-4a25-9d57-c075dbfa5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.412803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e85eb-60da-4a25-9d57-c075dbfa5aa7 admin admin] PATH_INFO: `/v3/projects/b912daebae234ae09dbc7f14228eda8c/users/cc823817f6c542599452c74f43b96e6f/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.459100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e85eb-60da-4a25-9d57-c075dbfa5aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b912daebae234ae09dbc7f14228eda8c, user_id=cc823817f6c542599452c74f43b96e6f, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.461971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e85eb-60da-4a25-9d57-c075dbfa5aa7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.488269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c315544eac654c4bb46744ec4a0d0d49', 'request_id': 'req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.493712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 989/1986] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:14 2022] PUT /identity/v3/projects/b912daebae234ae09dbc7f14228eda8c/users/cc823817f6c542599452c74f43b96e6f/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:14.495335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.495621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.495899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.499241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c315544eac654c4bb46744ec4a0d0d49', 'request_id': 'req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.511189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c315544eac654c4bb46744ec4a0d0d49', 'request_id': 'req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.527413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:14.529701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] The token cache is being invalidate because project c315544eac654c4bb46744ec4a0d0d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:14.529848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.530740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31dbd1f-3479-47df-80ac-ad4faa6f14bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.533727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] MFA Rules not processed for user `cc823817f6c542599452c74f43b96e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:14.535184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.536189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 998/1987] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:14 2022] DELETE /identity/v3/projects/c315544eac654c4bb46744ec4a0d0d49 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:14.539274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.539901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.540565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.563249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:14.564514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.609712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:14.643081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 990/1988] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:14.643971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.656031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.663287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 999/1989] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:14.671742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.671742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.673419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52399-78f8-45c0-bb1b-9673844cfa1c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.679471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.680173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.680455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.680730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] PATH_INFO: `/v3/users/b2285e79530340578f1db602f79e464d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.681966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2285e79530340578f1db602f79e464d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.683917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.697043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc524-9dc1-4ef7-9dd2-319ca76212d8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.705124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.705801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.706076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.706767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] PATH_INFO: `/v3/projects/7993d017185140a8a3adb03d6466c144` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.708727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7993d017185140a8a3adb03d6466c144)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:14.711348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:14.768172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2285e79530340578f1db602f79e464d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.783948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2285e79530340578f1db602f79e464d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.784841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7993d017185140a8a3adb03d6466c144', 'request_id': 'req-74152902-8e13-481b-aacb-5db0ca788838'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.786581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2285e79530340578f1db602f79e464d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.792361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7993d017185140a8a3adb03d6466c144', 'request_id': 'req-74152902-8e13-481b-aacb-5db0ca788838'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.806466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7993d017185140a8a3adb03d6466c144', 'request_id': 'req-74152902-8e13-481b-aacb-5db0ca788838'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.807974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2285e79530340578f1db602f79e464d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.817169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed349f45-2101-4b60-b427-6d733e4715c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2285e79530340578f1db602f79e464d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.820227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] The token cache is being invalidate because project 7993d017185140a8a3adb03d6466c144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:14.820512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.821186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:14.826383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1000/1990] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:14 2022] DELETE /identity/v3/projects/7993d017185140a8a3adb03d6466c144 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:14.826383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:14.826383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.830574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 991/1991] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:14 2022] DELETE /identity/v3/users/b2285e79530340578f1db602f79e464d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:14.830574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd318a-90a3-4d45-a5ba-c653623d5c06 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.830574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd318a-90a3-4d45-a5ba-c653623d5c06 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.830574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd318a-90a3-4d45-a5ba-c653623d5c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.851087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6abd318a-90a3-4d45-a5ba-c653623d5c06 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:14.852477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6abd318a-90a3-4d45-a5ba-c653623d5c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.898467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74152902-8e13-481b-aacb-5db0ca788838 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:14.924254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 992/1992] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:14.925859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7730f52-3811-4609-b11d-c585214bee4a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.926264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7730f52-3811-4609-b11d-c585214bee4a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.928531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7730f52-3811-4609-b11d-c585214bee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.949909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d7730f52-3811-4609-b11d-c585214bee4a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:14.951443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d7730f52-3811-4609-b11d-c585214bee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.961553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 993/1993] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:14.965321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:14.965954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.966234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.966504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.968370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:14.969739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:14.970310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:14.971998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:14.994696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:14.996128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.004395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:15.010765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 994/1994] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:15.011814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.018232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:15.024424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5ec54-a00b-443d-a86f-3e8dc8da5187 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.036300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.038954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.039505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.040143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.041384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:15.042563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.053152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.063480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.065017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b2e5f-59c0-4b89-9a7b-7899115c324e service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.077168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1001/1995] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:15.078559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.078859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.079203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 995/1996] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:15.080140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.082843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.083418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.109097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:15.110601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.124411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1002/1997] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:15.125655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.140065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3528c6-d5b0-443e-88ae-167404e2bbcc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.146587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.147266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.147642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.147922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.148741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.152135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.196039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1003/1998] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:15.196904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.198708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.207457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063df4e-8cbe-4384-98c8-e0be9ac7e497 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.268655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7bc4-9c58-489f-beee-f997045eb0cc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.273712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.274098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.274824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.274824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] PATH_INFO: `/v3/users/cc823817f6c542599452c74f43b96e6f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.275787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc823817f6c542599452c74f43b96e6f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.277611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.278049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.278462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.278896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.279271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.289638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.291246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.301906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 996/1999] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:15.305211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.314265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748f531-eeef-41c0-b4f7-0976d9e9bf9f service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.320632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.321436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.321835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.322431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.323123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:15.323582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.325548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.343707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc823817f6c542599452c74f43b96e6f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:15.344424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc823817f6c542599452c74f43b96e6f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:15.345172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc823817f6c542599452c74f43b96e6f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:15.361440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc823817f6c542599452c74f43b96e6f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:15.362266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 997/2000] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:15.363427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.365495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.370209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc823817f6c542599452c74f43b96e6f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:15.381508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c771132-2818-4a7a-b0c7-dc2cfcf934d2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.390512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1004/2001] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:15 2022] DELETE /identity/v3/users/cc823817f6c542599452c74f43b96e6f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:15.390512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.390512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.391873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794e014-2d91-42e2-aef4-d922aa9bd105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.392837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e014-2d91-42e2-aef4-d922aa9bd105 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.393342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e014-2d91-42e2-aef4-d922aa9bd105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.393837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e014-2d91-42e2-aef4-d922aa9bd105 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.394745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794e014-2d91-42e2-aef4-d922aa9bd105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.398040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794e014-2d91-42e2-aef4-d922aa9bd105 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.424325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:15.436026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 998/2002] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/users => generated 300 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:15.438388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.439383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.439932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.494953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:15.496290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.500658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4318-50f9-4a2d-addb-9c9cd22ecf70 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.506407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 999/2003] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:15.507385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.517521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.517956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.518342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.518722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.519462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.521732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcac10-b395-4e4b-a65a-c00e62b0d84b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.522916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.532774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.533616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.534071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.534448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.535213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.538128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.559585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1000/2004] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:15.559807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.562119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.599994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1005/2005] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/projects => generated 357 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:15.599994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.633979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada5b6e-5e05-4538-9dd9-d02f1227b698 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.648282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:15.702646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6062c-4a9d-46f7-b2e9-52ea90477926 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.716233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.717351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.717740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.718117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.718922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.720765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.753230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.753762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1006/2006] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:15.753879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.754146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.754420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.755034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.767279 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.768876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.778454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587e60-aea6-4580-8a19-56beecebd0de admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.783754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1001/2007] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:15.784835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.792148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.793136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.793486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.793856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.794558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.795907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752846-9eb4-4958-a744-0dd05a26e4d7 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.797532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.801429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9dc20-e699-4116-b7f5-e38406a799db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.802298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9dc20-e699-4116-b7f5-e38406a799db admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.802679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9dc20-e699-4116-b7f5-e38406a799db admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.803029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9dc20-e699-4116-b7f5-e38406a799db admin admin] PATH_INFO: `/v3/projects/f18784c469204ecab6b19bad83d1c697/users/e36c6ff729aa4b1abe0f72bae37e2229/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.825827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9dc20-e699-4116-b7f5-e38406a799db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18784c469204ecab6b19bad83d1c697, user_id=e36c6ff729aa4b1abe0f72bae37e2229, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.829873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9dc20-e699-4116-b7f5-e38406a799db admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.839682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1007/2008] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/users => generated 279 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:15.843732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.854691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1002/2009] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:15 2022] PUT /identity/v3/projects/f18784c469204ecab6b19bad83d1c697/users/e36c6ff729aa4b1abe0f72bae37e2229/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:15.863248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b497e-cabd-42e8-abfa-2f7398f89fc6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:15.869365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b678-6d15-4328-8243-3321b670374f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.870133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b678-6d15-4328-8243-3321b670374f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.870133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b678-6d15-4328-8243-3321b670374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.946649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-34c2b678-6d15-4328-8243-3321b670374f None None] MFA Rules not processed for user `e36c6ff729aa4b1abe0f72bae37e2229`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:15.949981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-34c2b678-6d15-4328-8243-3321b670374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:15.967244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:15.967838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:15.968178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:15.968608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:15.969140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:15.970916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:15.986902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1008/2010] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:15.986902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:15.988319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:16.003241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c539-0a2b-44a3-a0ea-e81500554c93 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:16.009701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:16.011314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.011947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.011947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] PATH_INFO: `/v3/projects/0a763182e3764541a8a1e56f0e7354fc` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.013243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a763182e3764541a8a1e56f0e7354fc)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:16.015646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:16.045967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:16.098399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a763182e3764541a8a1e56f0e7354fc', 'request_id': 'req-3b6d8e41-2bab-4e56-8463-89375e8ed281'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.098991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1003/2011] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:16.104851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2b678-6d15-4328-8243-3321b670374f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:16.112970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a763182e3764541a8a1e56f0e7354fc', 'request_id': 'req-3b6d8e41-2bab-4e56-8463-89375e8ed281'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.134657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a763182e3764541a8a1e56f0e7354fc', 'request_id': 'req-3b6d8e41-2bab-4e56-8463-89375e8ed281'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.149262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2b678-6d15-4328-8243-3321b670374f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:16.173283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] The token cache is being invalidate because project 0a763182e3764541a8a1e56f0e7354fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:16.175563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.177551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.183409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1009/2012] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:15 2022] DELETE /identity/v3/projects/0a763182e3764541a8a1e56f0e7354fc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:16.185805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:16.189175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:16.236534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:16.237161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.237441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.237716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.238369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:16.240679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:16.256750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1004/2013] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:16.257710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:16.261531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:16.288153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3c7b-aaa8-423e-a585-7d76b251afdc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:16.293738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:16.294583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.295025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.295697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] PATH_INFO: `/v3/users/3c95dbd5127048b68d755c02c5655eec` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.297065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c95dbd5127048b68d755c02c5655eec)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:16.299147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:16.316150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:16.320109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d8e41-2bab-4e56-8463-89375e8ed281 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:16.324701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:16.325567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.325853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.327606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.331031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:16.366900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c95dbd5127048b68d755c02c5655eec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.378440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c95dbd5127048b68d755c02c5655eec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.379733 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c95dbd5127048b68d755c02c5655eec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.398618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c95dbd5127048b68d755c02c5655eec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.407822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c95dbd5127048b68d755c02c5655eec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:16.415355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1005/2014] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:16 2022] DELETE /identity/v3/users/3c95dbd5127048b68d755c02c5655eec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:16.416168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:16.416900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:16.418490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1fda-7471-4dd5-aaf0-10550d6e0f5b service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:16.421392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:16.441930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1010/2015] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:16.514178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feb1f4-7630-4ab1-a1bc-5b19a8e10aaf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:16.521149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:16.522130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.522508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.522923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] PATH_INFO: `/v3/projects/85c9d9a7bf4340c8a7295c054e602471/users/0b0628ed0a1a4486b59667348f98a01f/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.544419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c9d9a7bf4340c8a7295c054e602471, user_id=0b0628ed0a1a4486b59667348f98a01f, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:16.554189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:16.588042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1006/2016] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:16 2022] PUT /identity/v3/projects/85c9d9a7bf4340c8a7295c054e602471/users/0b0628ed0a1a4486b59667348f98a01f/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:16.596903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.597267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.597520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.682315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] MFA Rules not processed for user `0b0628ed0a1a4486b59667348f98a01f`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:16.684483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:16.745121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:16.786027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1011/2017] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:16.787780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:16.943876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798111e-8669-4076-85cc-838e547e4d2e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:16.956929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:16.957577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:16.958893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:16.960320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:16.960988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:16.967737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.019365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:17.030077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1007/2018] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:16 2022] POST /identity/v3/projects => generated 355 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:17.040328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.059273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.061453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.086514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaaef5-7ab4-47ba-9e3e-0af8049926be None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.169588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.170751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.170751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.170999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.171597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.173799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.183630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748039c-51ec-479a-aa2f-eb6ea43f35e3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.192671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.194058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.194633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.195144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] PATH_INFO: `/v3/projects/2d00b2e6061c41c096ac126186cfce47` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.197143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d00b2e6061c41c096ac126186cfce47)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.198435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1012/2019] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:17 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:17.200954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.202014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.214762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9a4f9-0944-48b4-be6a-238b655fc20a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.220157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.220885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.221234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.221574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.222314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.224528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.241123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1013/2020] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:17.242232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.256198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdbad5-37f2-43f1-8a3f-d1c32a1dd91c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.268811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d00b2e6061c41c096ac126186cfce47', 'request_id': 'req-78ee9572-143e-4bb0-ac69-9a1528e9a257'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.276498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d00b2e6061c41c096ac126186cfce47', 'request_id': 'req-78ee9572-143e-4bb0-ac69-9a1528e9a257'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.294373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d00b2e6061c41c096ac126186cfce47', 'request_id': 'req-78ee9572-143e-4bb0-ac69-9a1528e9a257'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.322284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] The token cache is being invalidate because project 2d00b2e6061c41c096ac126186cfce47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:17.322422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.323167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.334623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1008/2021] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:17 2022] DELETE /identity/v3/projects/2d00b2e6061c41c096ac126186cfce47 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:17.336171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.337574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.362334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541a9b3-b0c6-4cc6-a767-51d2397f086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.363015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a9b3-b0c6-4cc6-a767-51d2397f086e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.363296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a9b3-b0c6-4cc6-a767-51d2397f086e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.363568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a9b3-b0c6-4cc6-a767-51d2397f086e admin admin] PATH_INFO: `/v3/projects/cc56e815b7b94072a1f4d2d6d12ce5ea/users/b4e65013b52842e6b639adeddc83d0b5/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.400801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541a9b3-b0c6-4cc6-a767-51d2397f086e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc56e815b7b94072a1f4d2d6d12ce5ea, user_id=b4e65013b52842e6b639adeddc83d0b5, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.408719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541a9b3-b0c6-4cc6-a767-51d2397f086e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.437785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1014/2022] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:17 2022] PUT /identity/v3/projects/cc56e815b7b94072a1f4d2d6d12ce5ea/users/b4e65013b52842e6b639adeddc83d0b5/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:17.439061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.439368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.439627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.473259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:17.475119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.480658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee9572-143e-4bb0-ac69-9a1528e9a257 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.540091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:17.549925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:17.583863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.584935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.585487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.585976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] PATH_INFO: `/v3/projects/b912daebae234ae09dbc7f14228eda8c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.587493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b912daebae234ae09dbc7f14228eda8c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.588540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1015/2023] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:17.589525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.590239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.597522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.612192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a990b5d-8e3a-4000-89a6-ff0ae4b2ee2e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.617817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592513a-95bb-41e2-801f-e6a9c10df918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.618575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592513a-95bb-41e2-801f-e6a9c10df918 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.618861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592513a-95bb-41e2-801f-e6a9c10df918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.619138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592513a-95bb-41e2-801f-e6a9c10df918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.619797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592513a-95bb-41e2-801f-e6a9c10df918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.621657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592513a-95bb-41e2-801f-e6a9c10df918 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.636379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1016/2024] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:17.639473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522aa3-960e-4ad4-9f81-6574b901721e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.640089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522aa3-960e-4ad4-9f81-6574b901721e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.640713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522aa3-960e-4ad4-9f81-6574b901721e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.682015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-02522aa3-960e-4ad4-9f81-6574b901721e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:17.684661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-02522aa3-960e-4ad4-9f81-6574b901721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.709924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b912daebae234ae09dbc7f14228eda8c', 'request_id': 'req-08b71dae-f500-4852-9310-b73ba52a115b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.745268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b912daebae234ae09dbc7f14228eda8c', 'request_id': 'req-08b71dae-f500-4852-9310-b73ba52a115b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.758703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b912daebae234ae09dbc7f14228eda8c', 'request_id': 'req-08b71dae-f500-4852-9310-b73ba52a115b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.783402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] The token cache is being invalidate because project b912daebae234ae09dbc7f14228eda8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:17.783696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.785307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:17.788377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1009/2025] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:17 2022] DELETE /identity/v3/projects/b912daebae234ae09dbc7f14228eda8c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:17.789431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.792477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.843341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1017/2026] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:17.843341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.843341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.843341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.876249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:17.879927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:17.903683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1018/2027] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:17.906617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:17.923065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f54d3-adf5-4c94-a662-6b60bca8fcb4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.936757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.937932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.938528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.939106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.940108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:17.940636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:17.944277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120d522-de81-45a5-a3b1-1f1f52b280a2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:17.959714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1019/2028] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:17.962019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.962814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.963305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.983152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71dae-f500-4852-9310-b73ba52a115b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:17.990123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:17.990280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:17.992619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:17.992952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:17.993229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] PATH_INFO: `/v3/projects/cc56e815b7b94072a1f4d2d6d12ce5ea/users/b4e65013b52842e6b639adeddc83d0b5/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:17.995321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:18.003164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc56e815b7b94072a1f4d2d6d12ce5ea, user_id=b4e65013b52842e6b639adeddc83d0b5, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.006395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1020/2029] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:18.007190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.007395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.019758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc298-edea-49e1-aa3d-95e4778a3cfa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.022179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1010/2030] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:17 2022] PUT /identity/v3/projects/cc56e815b7b94072a1f4d2d6d12ce5ea/users/b4e65013b52842e6b639adeddc83d0b5/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:18.023045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.140542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecf194-d7ee-42d2-8d19-9a09d6d8a24f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.159597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.160658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.160932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.162546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.164479 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:18.164924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.166890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f4d4-9d9e-4bc4-8d62-9f6f7137b1cc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.170011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:18.182990 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1011/2031] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:18.184393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f02924-fccb-487e-be06-5488950731d2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.184709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f02924-fccb-487e-be06-5488950731d2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.185016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f02924-fccb-487e-be06-5488950731d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.190367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.191770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.192242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.193265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.194266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.196998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.233130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-19f02924-fccb-487e-be06-5488950731d2 None None] MFA Rules not processed for user `b4e65013b52842e6b639adeddc83d0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:18.234717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-19f02924-fccb-487e-be06-5488950731d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:18.237297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1021/2032] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:18.238269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.284614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:18.316374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3939-622f-4cae-84c8-6ccfa81427a7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.322118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.322694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.323058 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.323336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.324334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.327296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.335685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1012/2033] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:18.335685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f02924-fccb-487e-be06-5488950731d2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.354380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f02924-fccb-487e-be06-5488950731d2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.362384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.363275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.363386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.364913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.365699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.368777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.373702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1022/2034] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:18.374860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.379185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:18.417539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1013/2035] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:18.417539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.430580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c9d3-4c1c-49f5-a5e3-6d89208ba422 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.477704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f936-7626-4a65-9dbe-15ac2adc9dad admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.481920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.482701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.483235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.483840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.513499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.514010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.514293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.514569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.515189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.517151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.543291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1014/2036] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:18.544502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.556976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6128c6-7ad9-4cd3-b42d-e29a49cf9b9f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.559636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.561123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.563168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.564057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.564527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.565365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.565888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.568495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.574190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1023/2037] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:18.574948 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.581852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1015/2038] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:18.585686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.590855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13471f-561d-4518-89a5-9d1da77ecd53 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.596499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.597131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.597464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.597746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.598272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333949-9440-4aa7-8a07-f0d2b47c0680 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.598386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.600101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.606737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.607441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.607825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.608239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.608984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.611529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.617185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1024/2039] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:18.620950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.627030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1016/2040] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:18.631770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.642331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07d2b4-4565-44b9-80b5-cd8b61aa3c84 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.645993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b8f1-d6dc-4e37-9113-49a6d6d4e5ec admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.648188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.649212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.649579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.649967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] PATH_INFO: `/v3/projects/5effeea341a24bf29ce74451dd40c19c/users/8d191b41d0be42268f746e8ba0e5c94b/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.653275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.654959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.655246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.656160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.657371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.659045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.680167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1025/2041] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:18.681175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.688644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5effeea341a24bf29ce74451dd40c19c, user_id=8d191b41d0be42268f746e8ba0e5c94b, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.694201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.703255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a392-ff09-4e09-a339-f77524d7aa1d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.716212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.717174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.717608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.718046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.723561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:18.726214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1017/2042] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:18 2022] PUT /identity/v3/projects/5effeea341a24bf29ce74451dd40c19c/users/8d191b41d0be42268f746e8ba0e5c94b/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:18.727166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:18.741346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:18.814048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:18.845758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.847607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815bdf-de85-4994-a192-c82f2956eea5 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.858800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1026/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:18.860229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.860421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.860687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.865285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851cd70-9250-4ac4-8f04-159e4600cc0e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:18.878067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72577c-7759-4d14-b215-2a61b3eddba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:18.878772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72577c-7759-4d14-b215-2a61b3eddba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.879207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72577c-7759-4d14-b215-2a61b3eddba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.879494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72577c-7759-4d14-b215-2a61b3eddba7 admin admin] PATH_INFO: `/v3/projects/9c122b1498f347a0b90ae97ee867791d/users/191d679d1fad45bb8560c9e952c97c45/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:18.906930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] MFA Rules not processed for user `8d191b41d0be42268f746e8ba0e5c94b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:18.907054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72577c-7759-4d14-b215-2a61b3eddba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c122b1498f347a0b90ae97ee867791d, user_id=191d679d1fad45bb8560c9e952c97c45, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:18.908368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:18.909844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72577c-7759-4d14-b215-2a61b3eddba7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:18.936076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1018/2044] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:18 2022] PUT /identity/v3/projects/9c122b1498f347a0b90ae97ee867791d/users/191d679d1fad45bb8560c9e952c97c45/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:18.945403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:18.945818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:18.946239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.001214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] MFA Rules not processed for user `191d679d1fad45bb8560c9e952c97c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:19.003393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:19.008703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1027/2045] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:19.014594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.050484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d716e0-378e-4a08-b7a2-2e421253fd2a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.159519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.160234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.160480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.160649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1019/2046] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:19.160746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.161566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.164585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.172812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.203465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1028/2047] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:19 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:19.204595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.283377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaf8b4-9170-44f4-b1f7-e43840ce60e0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.305585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9d1b-93c0-4aa9-9409-83ae71118c44 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.311589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.312365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.312862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.313229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.314432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.317135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.330543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:19.336104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:19.356007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1029/2048] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:19 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:19.356960 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.357589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.357873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.358143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.359569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.372349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e286c-039f-4663-88e5-56c603e48cd4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.379499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.381071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.381360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.382046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.383183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.384885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.404272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1030/2049] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:19.406723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.425579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bb41-2c9f-42d0-8b34-63087be57534 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.433258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.433927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.434210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.434486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] PATH_INFO: `/v3/projects/c7e098f745144cc98437ab0dbd206691/users/0ed0f03e34494dfcb27c36824325a077/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.456207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.456378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e098f745144cc98437ab0dbd206691, user_id=0ed0f03e34494dfcb27c36824325a077, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.458381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.459394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.495295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1031/2050] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:19 2022] PUT /identity/v3/projects/c7e098f745144cc98437ab0dbd206691/users/0ed0f03e34494dfcb27c36824325a077/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:19.495375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1020/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:19.497416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.573198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f3e7-32d2-4bf0-b095-551095132e1c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.579334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716997e9-fb3f-4045-852f-d2c9b307dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.579993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716997e9-fb3f-4045-852f-d2c9b307dbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.580259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716997e9-fb3f-4045-852f-d2c9b307dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.580531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716997e9-fb3f-4045-852f-d2c9b307dbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.581364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716997e9-fb3f-4045-852f-d2c9b307dbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.583144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716997e9-fb3f-4045-852f-d2c9b307dbd4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.596652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1032/2052] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:19.602878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.617558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96607cfe-4660-44d5-8b28-dfb74ee844bf service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.624395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.625077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.625433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.625786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] PATH_INFO: `/v3/projects/c7e098f745144cc98437ab0dbd206691/users/0ed0f03e34494dfcb27c36824325a077/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.628659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e098f745144cc98437ab0dbd206691, user_id=0ed0f03e34494dfcb27c36824325a077, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:19.632866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:19.646689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1021/2053] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:19 2022] PUT /identity/v3/projects/c7e098f745144cc98437ab0dbd206691/users/0ed0f03e34494dfcb27c36824325a077/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:19.658606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519f4c5-e45d-4bbf-9248-39e8840b8f36 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.659124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519f4c5-e45d-4bbf-9248-39e8840b8f36 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.659715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519f4c5-e45d-4bbf-9248-39e8840b8f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:19.709683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e519f4c5-e45d-4bbf-9248-39e8840b8f36 None None] MFA Rules not processed for user `0ed0f03e34494dfcb27c36824325a077`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:19.711159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e519f4c5-e45d-4bbf-9248-39e8840b8f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:19.842112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1033/2054] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:19.853102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:19.855102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:19.938466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b5e6-f840-4e4a-8af0-d7163270f340 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:19.943006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:19.943646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:19.944013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:19.944326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:20.019082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:20.020630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:20.032852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1022/2055] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:21.005614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354050e-b0b8-4d7d-90ce-da24967425e2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:21.006121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354050e-b0b8-4d7d-90ce-da24967425e2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:21.006214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354050e-b0b8-4d7d-90ce-da24967425e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:21.026372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7354050e-b0b8-4d7d-90ce-da24967425e2 None None] MFA Rules not processed for user `191d679d1fad45bb8560c9e952c97c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:21.027580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7354050e-b0b8-4d7d-90ce-da24967425e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:21.070520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:21.095548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1034/2056] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:22.022022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:22.023674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:22.084486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:22.143759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7f4e-26c7-4b81-a88a-99448d4c5453 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:22.149571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:22.150380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:22.151166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:22.151166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] PATH_INFO: `/v3/users/e36c6ff729aa4b1abe0f72bae37e2229` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:22.152512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36c6ff729aa4b1abe0f72bae37e2229)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:22.154749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:22.215564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36c6ff729aa4b1abe0f72bae37e2229'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:22.224654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36c6ff729aa4b1abe0f72bae37e2229'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:22.225468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36c6ff729aa4b1abe0f72bae37e2229'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:22.240775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36c6ff729aa4b1abe0f72bae37e2229'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:22.253501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36c6ff729aa4b1abe0f72bae37e2229'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:22.266394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1023/2057] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:22 2022] DELETE /identity/v3/users/e36c6ff729aa4b1abe0f72bae37e2229 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:22.271503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:22.271503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:22.272195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:22.292843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:22.293309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:22.364580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1035/2058] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:22.376019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:22.377886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:22.455784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31153c-95eb-4635-ae82-c2e8a289db0f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:22.460333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:22.460964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:22.461249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:22.461519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:22.471479 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:22.472954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:22.484165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1024/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:22.934799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:22.940627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:22.979118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9c67c-e135-4779-9cf3-31acfda1697f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:22.987150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:22.992306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:22.992838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:22.993283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] PATH_INFO: `/v3/projects/f18784c469204ecab6b19bad83d1c697` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:22.998753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18784c469204ecab6b19bad83d1c697)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:23.008571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:23.153867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18784c469204ecab6b19bad83d1c697', 'request_id': 'req-6e1ede47-edff-4903-8220-cb435ffad752'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:23.207925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18784c469204ecab6b19bad83d1c697', 'request_id': 'req-6e1ede47-edff-4903-8220-cb435ffad752'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:23.231515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18784c469204ecab6b19bad83d1c697', 'request_id': 'req-6e1ede47-edff-4903-8220-cb435ffad752'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:23.265615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] The token cache is being invalidate because project f18784c469204ecab6b19bad83d1c697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:23.268125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:23.272010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:23.279751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1036/2060] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:22 2022] DELETE /identity/v3/projects/f18784c469204ecab6b19bad83d1c697 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:24.912607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:24.915289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:24.988429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958af8-3613-48ff-b598-51d3997f19f4 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:24.994364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:25.069487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:25.069487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:25.069487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:25.069487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:25.070865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:25.151010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:25.152587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1cfeb-60d1-428d-b81d-743afa895813 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:25.167167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1025/2061] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:30.285108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:30.288945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:30.363084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ede47-edff-4903-8220-cb435ffad752 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:30.367703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:30.368364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:30.368639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:30.368966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] PATH_INFO: `/v3/users/8d191b41d0be42268f746e8ba0e5c94b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:30.370116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d191b41d0be42268f746e8ba0e5c94b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:30.372084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:30.382752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:30.421100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d191b41d0be42268f746e8ba0e5c94b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:30.421843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d191b41d0be42268f746e8ba0e5c94b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:30.422845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d191b41d0be42268f746e8ba0e5c94b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:30.435413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d191b41d0be42268f746e8ba0e5c94b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:30.442556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d191b41d0be42268f746e8ba0e5c94b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:30.457817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1037/2062] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:30 2022] DELETE /identity/v3/users/8d191b41d0be42268f746e8ba0e5c94b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:30.462376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:30.462891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:30.462993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:30.482239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:30.483443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:30.555946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1026/2063] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:30.565608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:30.567125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:30.624980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4b68-8dd5-42a5-a74d-3ba7bd7d6b04 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:30.628615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:30.629258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:30.629538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:30.629808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:30.638713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:30.640177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:30.650091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1038/2064] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:31.134875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:31.136466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:31.150798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067948-3476-4a38-b27e-69a3adf9ff7d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:31.156776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:31.157931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:31.158117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:31.158505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] PATH_INFO: `/v3/projects/5effeea341a24bf29ce74451dd40c19c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:31.160054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5effeea341a24bf29ce74451dd40c19c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:31.163046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:31.242067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5effeea341a24bf29ce74451dd40c19c', 'request_id': 'req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.249269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:31.251559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5effeea341a24bf29ce74451dd40c19c', 'request_id': 'req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.264477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5effeea341a24bf29ce74451dd40c19c', 'request_id': 'req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.286147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] The token cache is being invalidate because project 5effeea341a24bf29ce74451dd40c19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:31.286447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.287113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.289001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1027/2065] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:31 2022] DELETE /identity/v3/projects/5effeea341a24bf29ce74451dd40c19c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:31.292835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:31.304900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c65cf-89f2-4239-93a1-5f8300e87efd service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:31.395461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:31.396289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:31.396501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:31.396715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] PATH_INFO: `/v3/users/0ed0f03e34494dfcb27c36824325a077` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:31.397900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed0f03e34494dfcb27c36824325a077)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:31.400197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:31.448779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:31.464190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed0f03e34494dfcb27c36824325a077'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.464883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed0f03e34494dfcb27c36824325a077'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.465493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed0f03e34494dfcb27c36824325a077'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.479309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed0f03e34494dfcb27c36824325a077'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.486180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4c0c5f35-c680-4387-b7d5-ebfde5ea6ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed0f03e34494dfcb27c36824325a077'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:31.499488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1039/2066] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:31 2022] DELETE /identity/v3/users/0ed0f03e34494dfcb27c36824325a077 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:31.981396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:31.984287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:31.997806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa34e4-6a3d-42ea-96cc-25fa3abf0555 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.072386 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.073143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.073541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.073921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] PATH_INFO: `/v3/projects/c7e098f745144cc98437ab0dbd206691` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.081584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e098f745144cc98437ab0dbd206691)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.086738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.220355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e098f745144cc98437ab0dbd206691', 'request_id': 'req-d83a4f90-4d3d-4831-8448-496c02d19c62'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:32.232871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e098f745144cc98437ab0dbd206691', 'request_id': 'req-d83a4f90-4d3d-4831-8448-496c02d19c62'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:32.250061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e098f745144cc98437ab0dbd206691', 'request_id': 'req-d83a4f90-4d3d-4831-8448-496c02d19c62'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:32.267685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] The token cache is being invalidate because project c7e098f745144cc98437ab0dbd206691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:32.268229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:32.268989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d83a4f90-4d3d-4831-8448-496c02d19c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:32.270880 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1028/2067] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:31 2022] DELETE /identity/v3/projects/c7e098f745144cc98437ab0dbd206691 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:32.277376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.278416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.278702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.323394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:32.324857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:32.451033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1040/2068] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:32.452252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.452586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.452823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.499854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:32.501132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:32.525643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1029/2069] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:32.530719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.553013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4d7d6-3c9d-417b-9161-5b38a6bab5d0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.560472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.561702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.562076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.562441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.563250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:32.563670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.567746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.606467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1041/2070] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:32.608942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.621010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f58c4-d713-4d52-867f-3034976286f0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.626969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.627938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.628446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.628898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.630255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.632337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.677794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1030/2071] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:32 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:32.681629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.694877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121899a0-abb0-412d-81bd-edb9d8c6dd1f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.770926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.771799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.772262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.772695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.773459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.776834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.823701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1042/2072] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:32 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:32.825440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.838571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b3e6-c516-4350-9b5e-1b8015774011 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.848443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.849156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.850399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.850399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.851189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.853134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.869532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1031/2073] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:32.870893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.885652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f1810-0a03-4b98-87d1-f1fbe7f903e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.892691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.893528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.893981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.894449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.895481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.897520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.917607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1043/2074] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:32.918683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.931798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db450b-1720-48e1-b0e3-680059d20ba6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.939414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293d59-3a26-41c2-a1e4-6a5522da4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.940288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293d59-3a26-41c2-a1e4-6a5522da4140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.941174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:32.941322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293d59-3a26-41c2-a1e4-6a5522da4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.941795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293d59-3a26-41c2-a1e4-6a5522da4140 admin admin] PATH_INFO: `/v3/projects/a417627fdb3848dcaffe4d1e89cd5555/users/4018a4485091412f883642fa07111425/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.944558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:32.961520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6420f8-5de0-4462-8419-69629636bef6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:32.967879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:32.968684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:32.968967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:32.970367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] PATH_INFO: `/v3/users/beaa61185a6144b3b9c7db1a378c46b0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:32.971367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaa61185a6144b3b9c7db1a378c46b0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.971824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293d59-3a26-41c2-a1e4-6a5522da4140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a417627fdb3848dcaffe4d1e89cd5555, user_id=4018a4485091412f883642fa07111425, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:32.974114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.977492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293d59-3a26-41c2-a1e4-6a5522da4140 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:32.987888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:33.009105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1032/2075] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:32 2022] PUT /identity/v3/projects/a417627fdb3848dcaffe4d1e89cd5555/users/4018a4485091412f883642fa07111425/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:33.011721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.012074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.012315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.054345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:33.057454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaa61185a6144b3b9c7db1a378c46b0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.058240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaa61185a6144b3b9c7db1a378c46b0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.059135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaa61185a6144b3b9c7db1a378c46b0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.066817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] MFA Rules not processed for user `4018a4485091412f883642fa07111425`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:33.068793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:33.074779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaa61185a6144b3b9c7db1a378c46b0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.085571 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaa61185a6144b3b9c7db1a378c46b0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.105594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1044/2076] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:32 2022] DELETE /identity/v3/users/beaa61185a6144b3b9c7db1a378c46b0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:33.164846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1033/2077] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:33.177391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.178852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:33.237782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b48f-aa73-4353-b482-c30e30736432 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.242075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491576c0-1524-40fe-a42e-858870afc484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.242688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491576c0-1524-40fe-a42e-858870afc484 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.242968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491576c0-1524-40fe-a42e-858870afc484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.243239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491576c0-1524-40fe-a42e-858870afc484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.284943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.287310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:33.312848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491576c0-1524-40fe-a42e-858870afc484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.314383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491576c0-1524-40fe-a42e-858870afc484 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.324031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1045/2078] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:33.356194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8aa8-18c4-4256-b416-0e41f8fdbdfb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.412484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.413121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.413398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.413669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] PATH_INFO: `/v3/projects/d6ea6b54ec784e82b86c7ba2649bcb61` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.414808 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ea6b54ec784e82b86c7ba2649bcb61)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.416776 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.462376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:33.463849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ea6b54ec784e82b86c7ba2649bcb61', 'request_id': 'req-84700d19-b711-497a-b042-98036d93a76a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.471630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ea6b54ec784e82b86c7ba2649bcb61', 'request_id': 'req-84700d19-b711-497a-b042-98036d93a76a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.480158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ea6b54ec784e82b86c7ba2649bcb61', 'request_id': 'req-84700d19-b711-497a-b042-98036d93a76a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.493718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] The token cache is being invalidate because project d6ea6b54ec784e82b86c7ba2649bcb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:33.494009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.494650 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-84700d19-b711-497a-b042-98036d93a76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:33.499603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1034/2079] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:33 2022] DELETE /identity/v3/projects/d6ea6b54ec784e82b86c7ba2649bcb61 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:33.501116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.501404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.501680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.527605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:33.528909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:33.575499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:33.602044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1046/2080] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:33.612882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.613390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.613724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.636496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:33.637924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:33.653230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1035/2081] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:33.658457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.682901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45160-b72d-4f50-8752-85efcbead438 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.689068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.696122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.696122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.696122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.696122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:33.696122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.696122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.713507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1047/2082] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:21:33.717861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.729343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731eb9-cb1f-4e2f-a406-892929faabb2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.734420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.735100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.735443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.735937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.737569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.739842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.778320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1036/2083] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:33 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:33.782237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.793489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c30879-f6f1-4145-b929-6b27540ce648 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.877624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.878240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.878520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.878794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.879488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.881464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.910121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1048/2084] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:33 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:33.910970 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.922204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0268c-4a50-4a13-8fe8-1e40c742e8f0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.929757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.930366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.930645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.930913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.931561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.933255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.943980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1037/2085] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:33.948242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.958400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51d32-cf4a-4695-8bea-2a722dd0492a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:33.964835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145224a-e6e2-463d-bdf0-8fdc8e4c187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:33.965535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145224a-e6e2-463d-bdf0-8fdc8e4c187f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:33.965809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145224a-e6e2-463d-bdf0-8fdc8e4c187f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:33.966080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145224a-e6e2-463d-bdf0-8fdc8e4c187f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:33.966741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145224a-e6e2-463d-bdf0-8fdc8e4c187f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:33.968516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145224a-e6e2-463d-bdf0-8fdc8e4c187f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:33.980645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1049/2086] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:33.984909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:33.997016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5c7a3-a17d-4406-9ed2-6760b0069359 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.003033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.003797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.004380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.004666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] PATH_INFO: `/v3/projects/619e84b71d64487690f7ab522263d940/users/ad66fd23e5d24642ba3ef42ea827232e/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.023313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] RBAC: Authorizing `identity:create_grant(project_id=619e84b71d64487690f7ab522263d940, user_id=ad66fd23e5d24642ba3ef42ea827232e, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.026080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.044243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1038/2087] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:33 2022] PUT /identity/v3/projects/619e84b71d64487690f7ab522263d940/users/ad66fd23e5d24642ba3ef42ea827232e/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:34.053537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.053995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.054408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.106858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] MFA Rules not processed for user `ad66fd23e5d24642ba3ef42ea827232e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:34.108283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:34.201520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1050/2088] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:34.202328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.288186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd371d9c-edeb-4d37-8178-438f52ab245a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.293191 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.294382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.294382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.294966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.295691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.297855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.329339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1039/2089] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:34 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:34.334089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.344922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ae408-d371-4d75-a855-cfef55e0edf2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.383351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:34.409919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.411283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.411631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.411979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.412848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.414940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.437146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1051/2090] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:34 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:34.441881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.452224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80a968-4ad0-4886-8d9b-e0c74852a5bf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.456948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.458199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.458481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.458758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.459406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.461083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.472211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1040/2091] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:34.476708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.486988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9474-c8f7-45f3-b040-4c3d93e1e60b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.491768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.492454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.492731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.493043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] PATH_INFO: `/v3/projects/102dbc9a071648dcb378bf35f6798474/users/d4f7a77ba25b43b3a1c81c6763dcaf2a/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.508661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102dbc9a071648dcb378bf35f6798474, user_id=d4f7a77ba25b43b3a1c81c6763dcaf2a, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.511326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.523853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1052/2092] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:34 2022] PUT /identity/v3/projects/102dbc9a071648dcb378bf35f6798474/users/d4f7a77ba25b43b3a1c81c6763dcaf2a/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:34.527756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.537547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047ad0f-ca0c-4e83-9be4-927604e78b2a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.580193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:34.594477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae5180-4017-4e3e-9266-b3fce4eea107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.595076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae5180-4017-4e3e-9266-b3fce4eea107 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.595355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae5180-4017-4e3e-9266-b3fce4eea107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.595626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae5180-4017-4e3e-9266-b3fce4eea107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.596294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae5180-4017-4e3e-9266-b3fce4eea107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.597924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae5180-4017-4e3e-9266-b3fce4eea107 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.607794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1041/2093] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:34.612057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.622556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf918d-54f3-40c7-b99b-58129b716606 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.627146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.627793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.628113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.628391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] PATH_INFO: `/v3/projects/102dbc9a071648dcb378bf35f6798474/users/d4f7a77ba25b43b3a1c81c6763dcaf2a/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.630799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102dbc9a071648dcb378bf35f6798474, user_id=d4f7a77ba25b43b3a1c81c6763dcaf2a, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.633483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.643386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1053/2094] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:34 2022] PUT /identity/v3/projects/102dbc9a071648dcb378bf35f6798474/users/d4f7a77ba25b43b3a1c81c6763dcaf2a/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:34.654044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.654331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.654604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.681814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] MFA Rules not processed for user `d4f7a77ba25b43b3a1c81c6763dcaf2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:34.683025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:34.761212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1042/2095] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:34.773397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.775112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:34.837264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549d12-19b0-43d2-b656-1d07ad8f2976 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.840922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.841532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.841807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.842076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:34.851817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:34.853387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:34.864953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1054/2096] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:34.956991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:34.966423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632749-c78e-4c80-b356-15cc814d1b1f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:34.970003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d6cc1-0294-4d0f-80eb-67b5ed687246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:34.970611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d6cc1-0294-4d0f-80eb-67b5ed687246 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:34.970892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d6cc1-0294-4d0f-80eb-67b5ed687246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:34.971166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d6cc1-0294-4d0f-80eb-67b5ed687246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:35.033852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d6cc1-0294-4d0f-80eb-67b5ed687246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:35.035302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d6cc1-0294-4d0f-80eb-67b5ed687246 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:35.044838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1043/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:35.386924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:35.388360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:35.455573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138986c4-31cc-46d8-87a9-5d2305e1a91c service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:35.460021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:35.460662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:35.460941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:35.461212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] PATH_INFO: `/v3/users/0b0628ed0a1a4486b59667348f98a01f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:35.462327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0628ed0a1a4486b59667348f98a01f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:35.464333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:35.500214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:35.511713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0628ed0a1a4486b59667348f98a01f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:35.512374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0628ed0a1a4486b59667348f98a01f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:35.512998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0628ed0a1a4486b59667348f98a01f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:35.524572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0628ed0a1a4486b59667348f98a01f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:35.531441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0628ed0a1a4486b59667348f98a01f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:35.544211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1055/2098] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:35 2022] DELETE /identity/v3/users/0b0628ed0a1a4486b59667348f98a01f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:35.548922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:35.549207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:35.549477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:35.568432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:35.569617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:35.625854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1044/2099] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:35.635474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:35.636946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:35.695232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fce75d-c5b0-4bc8-a5a6-5aa638f287e8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:35.698903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:35.699515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:35.699793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:35.700103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:35.709682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:35.711051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:35.720441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1056/2100] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:35.993013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:35.994446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:36.007532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4dd0-4e39-43e6-b8fa-11e305c3a756 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:36.015307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:36.016029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:36.016341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:36.016686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] PATH_INFO: `/v3/projects/85c9d9a7bf4340c8a7295c054e602471` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:36.018172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c9d9a7bf4340c8a7295c054e602471)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:36.020749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:36.022545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:36.070284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c9d9a7bf4340c8a7295c054e602471', 'request_id': 'req-f6fc2980-caf2-463d-827d-d14ca0087c4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.075890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c9d9a7bf4340c8a7295c054e602471', 'request_id': 'req-f6fc2980-caf2-463d-827d-d14ca0087c4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.084128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c9d9a7bf4340c8a7295c054e602471', 'request_id': 'req-f6fc2980-caf2-463d-827d-d14ca0087c4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.097611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] The token cache is being invalidate because project 85c9d9a7bf4340c8a7295c054e602471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:36.097925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.098667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.101467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1045/2101] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:35 2022] DELETE /identity/v3/projects/85c9d9a7bf4340c8a7295c054e602471 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:36.104793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:36.116283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8579b8-cea2-4261-a10c-01ee59598407 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:36.205953 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:36.206689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:36.208002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:36.208452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] PATH_INFO: `/v3/users/b4e65013b52842e6b639adeddc83d0b5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:36.210262 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e65013b52842e6b639adeddc83d0b5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:36.212455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:36.292389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e65013b52842e6b639adeddc83d0b5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.293124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e65013b52842e6b639adeddc83d0b5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.296231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e65013b52842e6b639adeddc83d0b5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.308436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:36.320961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e65013b52842e6b639adeddc83d0b5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.335764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4fd60667-c61f-41fd-86d9-f038c4995f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e65013b52842e6b639adeddc83d0b5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.357915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1057/2102] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:36 2022] DELETE /identity/v3/users/b4e65013b52842e6b639adeddc83d0b5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:36.821356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:36.823050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:36.843577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc2980-caf2-463d-827d-d14ca0087c4d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:36.914675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:36.915422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:36.915731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:36.916060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] PATH_INFO: `/v3/projects/cc56e815b7b94072a1f4d2d6d12ce5ea` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:36.917289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc56e815b7b94072a1f4d2d6d12ce5ea)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:36.919356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:36.981317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc56e815b7b94072a1f4d2d6d12ce5ea', 'request_id': 'req-19e67c4f-0588-433c-9483-fbfb2f3432c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.988712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc56e815b7b94072a1f4d2d6d12ce5ea', 'request_id': 'req-19e67c4f-0588-433c-9483-fbfb2f3432c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:36.997993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc56e815b7b94072a1f4d2d6d12ce5ea', 'request_id': 'req-19e67c4f-0588-433c-9483-fbfb2f3432c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:37.009607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] The token cache is being invalidate because project cc56e815b7b94072a1f4d2d6d12ce5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:37.009898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:37.010522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19e67c4f-0588-433c-9483-fbfb2f3432c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:37.012238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1046/2103] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:36 2022] DELETE /identity/v3/projects/cc56e815b7b94072a1f4d2d6d12ce5ea => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:37.017222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.017695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.017921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.040411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:37.041647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:37.107539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1058/2104] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:37.115929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.116433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.116521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.136607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:37.137847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:37.145723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1047/2105] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:37.149957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.159579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74543b92-629c-4e5d-ba3c-8d97738c7cea None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.164115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.164714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.164992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.165264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.165907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:37.166208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.167814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.179831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1059/2106] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:37.183879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.193511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed89d-fea9-4977-b92d-44421ba6fd6d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.198157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.198751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.199033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.199309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.199932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.201865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.214105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:37.231539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1048/2107] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:37.235242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.246395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b43bb-7995-4e7a-8a04-109bb6474a6f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.302349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.302955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.303235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.303507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.304164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.306088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.330527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1060/2108] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:37.331681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.342434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd23f4-c54d-49c2-a442-22b9aeed87fa admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.347108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.347729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.348040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.348319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.348958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.350557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.364007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1049/2109] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:37.365176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.375165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8a3ba-7a54-4c89-a1ac-f795f38bbede admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.380348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104a4a5-a0a9-45ba-9664-d1bc0772cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.380954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a4a5-a0a9-45ba-9664-d1bc0772cdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.381230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a4a5-a0a9-45ba-9664-d1bc0772cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.381500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a4a5-a0a9-45ba-9664-d1bc0772cdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.382142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a4a5-a0a9-45ba-9664-d1bc0772cdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.383779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a4a5-a0a9-45ba-9664-d1bc0772cdf0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.394944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1061/2110] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:37.398851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.408586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa31551-1e0b-4518-9210-add3df6f0538 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.413140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.413793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.414065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.414405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] PATH_INFO: `/v3/projects/2984ffab76be421e9f49ae7702f786ee/users/5a912c3506214b5bb819463ca59034c0/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.430698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2984ffab76be421e9f49ae7702f786ee, user_id=5a912c3506214b5bb819463ca59034c0, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.433520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.447653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1050/2111] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:37 2022] PUT /identity/v3/projects/2984ffab76be421e9f49ae7702f786ee/users/5a912c3506214b5bb819463ca59034c0/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:37.458730 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.459012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.459280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.487851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] MFA Rules not processed for user `5a912c3506214b5bb819463ca59034c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:37.489867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:37.517979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:37.555448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1062/2112] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:37.559943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.620104 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606f55-2176-47fb-a868-ed814b6de24c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.624754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.625356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.625641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.625915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.626533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.628498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.653889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1051/2113] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:37.658002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.668954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bc000-a088-42d1-8ac1-e896dd202d43 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.726443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.727050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.727326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.727594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.728269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.730205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.754695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1063/2114] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:37 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:37.758722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.768816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7be68-3946-4560-a8be-452d66404464 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.773551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.774150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.774428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.774698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.775332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.776989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.788721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1052/2115] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:37.792669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.804116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cf7c5-b450-4af9-a750-d2d59d551ada admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.808842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.809599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.810016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.810360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] PATH_INFO: `/v3/projects/dfe5c7e4c29348bd9fb669d1cd0f1e5c/users/0d4214d2e65b43d7a084cc21ccccfc13/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.828924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5c7e4c29348bd9fb669d1cd0f1e5c, user_id=0d4214d2e65b43d7a084cc21ccccfc13, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.831638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.846043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1064/2116] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:37 2022] PUT /identity/v3/projects/dfe5c7e4c29348bd9fb669d1cd0f1e5c/users/0d4214d2e65b43d7a084cc21ccccfc13/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:37.850681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.863398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7127253-a24d-41de-8708-b20b0e1e0aaf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.938673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ae5da-6fc1-4f4d-93ff-aee30915eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.939285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae5da-6fc1-4f4d-93ff-aee30915eef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.939568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae5da-6fc1-4f4d-93ff-aee30915eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.939837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae5da-6fc1-4f4d-93ff-aee30915eef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.940507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae5da-6fc1-4f4d-93ff-aee30915eef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.942135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae5da-6fc1-4f4d-93ff-aee30915eef8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.952190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1053/2117] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:37.956373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:37.968536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a702f-968f-4790-ab19-21ce6dc1a8c2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:37.974157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:37.975054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:37.975475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:37.976162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] PATH_INFO: `/v3/projects/dfe5c7e4c29348bd9fb669d1cd0f1e5c/users/0d4214d2e65b43d7a084cc21ccccfc13/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:37.978168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5c7e4c29348bd9fb669d1cd0f1e5c, user_id=0d4214d2e65b43d7a084cc21ccccfc13, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:37.981315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:37.994824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1065/2118] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:37 2022] PUT /identity/v3/projects/dfe5c7e4c29348bd9fb669d1cd0f1e5c/users/0d4214d2e65b43d7a084cc21ccccfc13/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:38.005155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:38.005657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:38.005989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:38.036218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] MFA Rules not processed for user `0d4214d2e65b43d7a084cc21ccccfc13`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:38.037519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:38.052238 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:38.113884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1054/2119] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:38.125735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:38.127651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:38.196079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264301-3702-4177-87e4-96fcf550aa6f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:38.201594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:38.202234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:38.202506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:38.202780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:38.217536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:38.219036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:38.231047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1066/2120] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:38.283585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:38.293919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f890-c5de-4b36-825d-66cce7841833 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:38.305109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98498ac8-cba2-4919-bf06-7a67ef1e02e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:38.305900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498ac8-cba2-4919-bf06-7a67ef1e02e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:38.306296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498ac8-cba2-4919-bf06-7a67ef1e02e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:38.306576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498ac8-cba2-4919-bf06-7a67ef1e02e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:38.370661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98498ac8-cba2-4919-bf06-7a67ef1e02e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:38.372151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98498ac8-cba2-4919-bf06-7a67ef1e02e5 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:38.382315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1055/2121] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:38.935050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:38.936594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:38.967135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:39.005842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117679b3-3d81-45c8-9335-57b3c42b5be0 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:39.011395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:39.012212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.012375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.012615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] PATH_INFO: `/v3/users/4018a4485091412f883642fa07111425` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:39.013754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4018a4485091412f883642fa07111425)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:39.015774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:39.065351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4018a4485091412f883642fa07111425'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.066018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4018a4485091412f883642fa07111425'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.066647 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4018a4485091412f883642fa07111425'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.078643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4018a4485091412f883642fa07111425'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.085692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4018a4485091412f883642fa07111425'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.099838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1067/2122] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:38 2022] DELETE /identity/v3/users/4018a4485091412f883642fa07111425 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:39.104583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.104946 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.105231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:39.126300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:39.127727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:39.191149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1056/2123] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:39.201039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:39.202587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:39.284341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5def9-5520-457c-a77c-fb892027118f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:39.291333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e1f99-8648-4981-ab4e-db4798be92e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:39.292025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e1f99-8648-4981-ab4e-db4798be92e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.292318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e1f99-8648-4981-ab4e-db4798be92e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.292593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e1f99-8648-4981-ab4e-db4798be92e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:39.303981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e1f99-8648-4981-ab4e-db4798be92e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:39.305479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e1f99-8648-4981-ab4e-db4798be92e9 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:39.317433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1068/2124] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:39.602589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:39.604575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:39.618857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773ff6-6c6e-4804-bfcc-14138e9f8b2a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:39.623828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:39.624429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.624806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.624983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] PATH_INFO: `/v3/projects/a417627fdb3848dcaffe4d1e89cd5555` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:39.626124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a417627fdb3848dcaffe4d1e89cd5555)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:39.628610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:39.678676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:39.681742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a417627fdb3848dcaffe4d1e89cd5555', 'request_id': 'req-1841848a-6c21-4c2d-9b40-a905d27d4c53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.687480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a417627fdb3848dcaffe4d1e89cd5555', 'request_id': 'req-1841848a-6c21-4c2d-9b40-a905d27d4c53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.700805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a417627fdb3848dcaffe4d1e89cd5555', 'request_id': 'req-1841848a-6c21-4c2d-9b40-a905d27d4c53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.750452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] The token cache is being invalidate because project a417627fdb3848dcaffe4d1e89cd5555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:39.750754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.753429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1841848a-6c21-4c2d-9b40-a905d27d4c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:39.755700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1057/2125] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:39 2022] DELETE /identity/v3/projects/a417627fdb3848dcaffe4d1e89cd5555 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:39.765215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.765530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.765813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:39.805992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:39.808401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:39.882145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:39.932938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.933263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.933545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:39.939047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1069/2126] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:39.958495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:39.960171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:39.978753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1058/2127] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:39.982742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:39.993529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc4a7-883b-40dc-94ca-7cebb3523d36 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:39.998535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:39.999150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:39.999434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:39.999990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.000721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:40.002285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.004617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.019052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1070/2128] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:21:40.023805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.034260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea139c7-7a67-4d0d-b7b1-6839ea47b113 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.039981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.040799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.041083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.041362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.042007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.044181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.076635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1059/2129] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:40 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:40.077818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.088710 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7207-f5f4-4669-b433-e7474a20ce1c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.148578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.149186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.149468 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.149739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.150361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.152312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.178933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1071/2130] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:40 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:40.180226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.192629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3613-d42a-4b5a-a07c-729eed4031ce admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.198057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.198611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.199096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.199414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.200117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.201782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.213356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1060/2131] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:40.217900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.230156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5bdc-080b-4afc-9af1-06d630678bf5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.237580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8423882-dc2f-48de-867c-a8a2075a6c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.238307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8423882-dc2f-48de-867c-a8a2075a6c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.238591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8423882-dc2f-48de-867c-a8a2075a6c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.238863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8423882-dc2f-48de-867c-a8a2075a6c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.239514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8423882-dc2f-48de-867c-a8a2075a6c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.241178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8423882-dc2f-48de-867c-a8a2075a6c02 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.252330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1072/2132] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:40.256727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.266689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d0f3a-c5eb-46a3-817e-9ebacb2a274d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.272607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.272736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.273193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.273476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] PATH_INFO: `/v3/projects/96abbc1c79a7419abca516c7556a535f/users/bd1bab7e87ff435da29d6abf2fd9d473/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.288981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96abbc1c79a7419abca516c7556a535f, user_id=bd1bab7e87ff435da29d6abf2fd9d473, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.291988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.305834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1061/2133] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:40 2022] PUT /identity/v3/projects/96abbc1c79a7419abca516c7556a535f/users/bd1bab7e87ff435da29d6abf2fd9d473/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:40.310979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92f368-09c4-4f57-9f3a-c653df23328c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.311296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92f368-09c4-4f57-9f3a-c653df23328c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.311600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92f368-09c4-4f57-9f3a-c653df23328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.331238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6d92f368-09c4-4f57-9f3a-c653df23328c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:40.334225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d92f368-09c4-4f57-9f3a-c653df23328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:40.396728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1073/2134] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:40.406217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.407896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:40.473629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b98c5-379d-49ef-98ba-8b7274bcc32f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.479273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.479892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.480203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.480483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.493253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.493253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.508100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1062/2135] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:40.660545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41cfba-a411-4bfe-8057-b482d0ba2012 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.660928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41cfba-a411-4bfe-8057-b482d0ba2012 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.661205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41cfba-a411-4bfe-8057-b482d0ba2012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.683345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7b41cfba-a411-4bfe-8057-b482d0ba2012 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:40.684311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7b41cfba-a411-4bfe-8057-b482d0ba2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:40.758423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:40.770095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1074/2136] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:40.783271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:40.785972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:40.867993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be21f96-5175-4615-ad60-6da188d6b786 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:40.873516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:40.874142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:40.874511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:40.875146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:40.885201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:40.887259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:40.897429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1063/2137] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:21:41.338734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c01b-414a-4438-ba6f-fb77896b1692 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:41.339194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c01b-414a-4438-ba6f-fb77896b1692 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:41.339273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c01b-414a-4438-ba6f-fb77896b1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:41.374505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d5e3c01b-414a-4438-ba6f-fb77896b1692 None None] MFA Rules not processed for user `bd1bab7e87ff435da29d6abf2fd9d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:41.376618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d5e3c01b-414a-4438-ba6f-fb77896b1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:41.464715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1075/2138] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:41.480278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:41.482308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:41.489512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:41.552326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9034-d92a-4d59-879f-434ab63873a8 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:41.556886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:41.557505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:41.557790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:41.558064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:41.566935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611fc5-6bd3-4e08-a2c9-6e209a537b9a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:41.567227 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611fc5-6bd3-4e08-a2c9-6e209a537b9a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:41.567525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611fc5-6bd3-4e08-a2c9-6e209a537b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:41.567829 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:41.569410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:41.579380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1064/2139] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:41.587350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-26611fc5-6bd3-4e08-a2c9-6e209a537b9a None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:41.588607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-26611fc5-6bd3-4e08-a2c9-6e209a537b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:41.597999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1076/2140] 10.222.0.23 () {58 vars in 967 bytes} [Wed Aug 17 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:41.611831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:41.624888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18f4c-0c9f-4c5c-b172-e00d9b307061 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:41.630323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:41.630940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:41.631220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:41.631497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:41.640819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:41.643412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:41.651820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1065/2141] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:21:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:21:41.958278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:41.958661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:41.959152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:41.982370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:41.983974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:41.985722 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:41.986899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:41.994681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1077/2142] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:41.998665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf15b0-091f-4247-9be1-ebfb7a4ad5d4 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.004723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.005512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.005857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.006252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] PATH_INFO: `/v3/users/5a912c3506214b5bb819463ca59034c0` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.007455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:42.008444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a912c3506214b5bb819463ca59034c0)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.010557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.020074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d810-f64d-448e-b984-76a77ede4242 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.026225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38344977-9f52-4fcb-84d6-6d9aafa2df7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.026840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38344977-9f52-4fcb-84d6-6d9aafa2df7a service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.027146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38344977-9f52-4fcb-84d6-6d9aafa2df7a service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.027394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38344977-9f52-4fcb-84d6-6d9aafa2df7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.036862 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38344977-9f52-4fcb-84d6-6d9aafa2df7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.038816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38344977-9f52-4fcb-84d6-6d9aafa2df7a service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.049178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1078/2143] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 14:21:42.064448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a912c3506214b5bb819463ca59034c0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.072611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a912c3506214b5bb819463ca59034c0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.073351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a912c3506214b5bb819463ca59034c0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.086055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a912c3506214b5bb819463ca59034c0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.094060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a912c3506214b5bb819463ca59034c0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.101966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1066/2144] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:41 2022] DELETE /identity/v3/users/5a912c3506214b5bb819463ca59034c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:42.106791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168241-239b-404a-ba39-58ff3b563119 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.107139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168241-239b-404a-ba39-58ff3b563119 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.107503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168241-239b-404a-ba39-58ff3b563119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.127732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aa168241-239b-404a-ba39-58ff3b563119 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:42.128991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aa168241-239b-404a-ba39-58ff3b563119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.195040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1079/2145] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:42.204575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:42.206130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.271095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcc64-08a6-444c-8ecb-c6f3769efcbd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.274734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.275368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.275768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.276073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.287685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.289149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.301060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1067/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:42.446488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.447292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.447736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.483553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:42.484907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.561092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1080/2147] 10.222.0.23 () {58 vars in 967 bytes} [Wed Aug 17 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:42.576938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:42.578528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.593795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:42.625113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:42.626741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.658567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e8cec-1f9f-4432-ab28-63f43b002aa6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.664520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.665174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.665450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.665718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] PATH_INFO: `/v3/projects/2984ffab76be421e9f49ae7702f786ee` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.666842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2984ffab76be421e9f49ae7702f786ee)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.668899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.670945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:42.679018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9023-739c-4a95-86d9-aa3714403d48 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.684351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.684962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.685240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.685509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.694505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.696167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.705372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1068/2148] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:21:42.706167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:42.707522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.721048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc51f4-bf6a-465f-8f4f-6291db5e361f service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.728254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2984ffab76be421e9f49ae7702f786ee', 'request_id': 'req-f8993532-4ce2-4ad0-b846-f0561b4eee68'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.738994 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2984ffab76be421e9f49ae7702f786ee', 'request_id': 'req-f8993532-4ce2-4ad0-b846-f0561b4eee68'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.748531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2984ffab76be421e9f49ae7702f786ee', 'request_id': 'req-f8993532-4ce2-4ad0-b846-f0561b4eee68'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.760843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] The token cache is being invalidate because project 2984ffab76be421e9f49ae7702f786ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:42.761355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.762229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.764350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1081/2149] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:42 2022] DELETE /identity/v3/projects/2984ffab76be421e9f49ae7702f786ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:42.768483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:42.770268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.798767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.799533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.799844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.800180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] PATH_INFO: `/v3/users/ad66fd23e5d24642ba3ef42ea827232e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.801991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad66fd23e5d24642ba3ef42ea827232e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.804564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.848925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8993532-4ce2-4ad0-b846-f0561b4eee68 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:42.854153 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:42.854924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.855282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.855625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] PATH_INFO: `/v3/users/0d4214d2e65b43d7a084cc21ccccfc13` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.856879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4214d2e65b43d7a084cc21ccccfc13)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:42.861926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:42.867086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad66fd23e5d24642ba3ef42ea827232e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.874693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad66fd23e5d24642ba3ef42ea827232e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.875468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad66fd23e5d24642ba3ef42ea827232e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.891061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad66fd23e5d24642ba3ef42ea827232e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.904580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6d4f4600-3f05-433d-8c17-96dc429a1863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad66fd23e5d24642ba3ef42ea827232e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.912639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1069/2150] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:42 2022] DELETE /identity/v3/users/ad66fd23e5d24642ba3ef42ea827232e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:42.917193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:42.917587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:42.918009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:42.926316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4214d2e65b43d7a084cc21ccccfc13'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.926985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4214d2e65b43d7a084cc21ccccfc13'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.927614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4214d2e65b43d7a084cc21ccccfc13'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.944431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:42.946062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:42.949020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4214d2e65b43d7a084cc21ccccfc13'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.958356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b9ffa88-e744-4ece-951f-05da93ed8731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4214d2e65b43d7a084cc21ccccfc13'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:42.961034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:42.980076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1082/2151] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:42 2022] DELETE /identity/v3/users/0d4214d2e65b43d7a084cc21ccccfc13 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:43.004839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.005130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.005407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.027561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] MFA Rules not processed for user `bd1bab7e87ff435da29d6abf2fd9d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:43.029076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:43.035249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:43.045055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1070/2152] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:43.057915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:43.060579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:43.131407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1083/2153] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:43.169166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ef8b8-624e-4ba9-a216-f1f90ee28685 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:43.248875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcd4bc-fe1d-4dd5-a16c-86bb84159db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:43.249613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd4bc-fe1d-4dd5-a16c-86bb84159db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.249992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd4bc-fe1d-4dd5-a16c-86bb84159db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.250361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd4bc-fe1d-4dd5-a16c-86bb84159db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.327229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd4bc-fe1d-4dd5-a16c-86bb84159db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:43.328917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd4bc-fe1d-4dd5-a16c-86bb84159db5 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:43.350452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1071/2154] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:43.410752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:43.412289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:43.440001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7945-e70f-4bc7-9121-b4608ee45d77 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:43.458624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:43.459987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.460257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.460527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] PATH_INFO: `/v3/projects/dfe5c7e4c29348bd9fb669d1cd0f1e5c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.461846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe5c7e4c29348bd9fb669d1cd0f1e5c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:43.465446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:43.538578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe5c7e4c29348bd9fb669d1cd0f1e5c', 'request_id': 'req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:43.546698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe5c7e4c29348bd9fb669d1cd0f1e5c', 'request_id': 'req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:43.559093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe5c7e4c29348bd9fb669d1cd0f1e5c', 'request_id': 'req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:43.584334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] The token cache is being invalidate because project dfe5c7e4c29348bd9fb669d1cd0f1e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:43.584876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:43.585757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cde977a7-41e9-48fa-8b95-9e92e7fe12ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:43.588212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1084/2155] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:43 2022] DELETE /identity/v3/projects/dfe5c7e4c29348bd9fb669d1cd0f1e5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:43.594930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.595516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.595893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.627254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:43.629424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:43.659204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:43.726594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1072/2156] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:43.731240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.733146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.733146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.773755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:43.776421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:43.796539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1085/2157] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:43.801047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:43.812080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117d8ca-ba6f-4174-b68c-b6898f5d18ad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:43.817821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:43.818580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.818868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.819152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.819804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:43.820322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:43.823818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:43.843199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1073/2158] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:43.844529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:43.856194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba621a8-6668-4788-bba9-c2adf247ec46 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:43.866199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:43.866903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:43.867259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:43.867613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:43.868422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:43.870655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:43.909882 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1086/2159] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:43 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:43.914320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:43.929909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c83fe7-f79f-41f8-9c57-0004df00ee14 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.017059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.020180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:44.029613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.030340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.030740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.031189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.032094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.034214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.072467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1074/2160] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:43 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:44.078093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.092737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7201be0-7cfe-4c5c-886f-f8542089a750 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.098858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.100156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.100448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.100720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.101533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.103383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.115991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1075/2161] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:44.119881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056ed5a-0f9b-44d7-a309-24ac9327e8c0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.120257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.132297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58acd-c619-498d-a04a-af4e571de5ef admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.135038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.136471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.137363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.137708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] PATH_INFO: `/v3/projects/619e84b71d64487690f7ab522263d940` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.139288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619e84b71d64487690f7ab522263d940)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.142156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.150057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.150685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.150963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.156197 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:44.164338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.165554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.167766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.180273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1076/2162] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:44.184411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.198870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8c058-994c-4e8f-8b2d-34fe1c211176 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.212060 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619e84b71d64487690f7ab522263d940', 'request_id': 'req-ba049ef0-de92-46fa-9b74-48b6c25ddc82'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.221293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619e84b71d64487690f7ab522263d940', 'request_id': 'req-ba049ef0-de92-46fa-9b74-48b6c25ddc82'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.232121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619e84b71d64487690f7ab522263d940', 'request_id': 'req-ba049ef0-de92-46fa-9b74-48b6c25ddc82'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.259281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] The token cache is being invalidate because project 619e84b71d64487690f7ab522263d940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:44.259281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.260387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.262849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1087/2163] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:44 2022] DELETE /identity/v3/projects/619e84b71d64487690f7ab522263d940 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:44.267090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.268653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:44.286153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa65c8-f4c2-45f6-812c-28574ac06db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.286818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa65c8-f4c2-45f6-812c-28574ac06db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.287098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa65c8-f4c2-45f6-812c-28574ac06db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.287369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa65c8-f4c2-45f6-812c-28574ac06db1 admin admin] PATH_INFO: `/v3/projects/8b303ea1fcb0418fbd8f9c46903384b3/users/4a54a6878c3d4dca9a1f7b078a5fee1d/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.305594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa65c8-f4c2-45f6-812c-28574ac06db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b303ea1fcb0418fbd8f9c46903384b3, user_id=4a54a6878c3d4dca9a1f7b078a5fee1d, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.309560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa65c8-f4c2-45f6-812c-28574ac06db1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.319725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:44.327143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1077/2164] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:44 2022] PUT /identity/v3/projects/8b303ea1fcb0418fbd8f9c46903384b3/users/4a54a6878c3d4dca9a1f7b078a5fee1d/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:44.342554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.342864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.343364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.374010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba049ef0-de92-46fa-9b74-48b6c25ddc82 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.378249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] MFA Rules not processed for user `4a54a6878c3d4dca9a1f7b078a5fee1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:44.379697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:44.445269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.445889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.446280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.446547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] PATH_INFO: `/v3/users/d4f7a77ba25b43b3a1c81c6763dcaf2a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.447723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f7a77ba25b43b3a1c81c6763dcaf2a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.449782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.457900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1078/2165] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:44.470836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.472819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:44.504992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f7a77ba25b43b3a1c81c6763dcaf2a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.506079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f7a77ba25b43b3a1c81c6763dcaf2a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.506685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f7a77ba25b43b3a1c81c6763dcaf2a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.508636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:44.525676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f7a77ba25b43b3a1c81c6763dcaf2a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.538653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f7a77ba25b43b3a1c81c6763dcaf2a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:44.553969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1088/2166] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:44 2022] DELETE /identity/v3/users/d4f7a77ba25b43b3a1c81c6763dcaf2a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:44.577998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8324-a9f3-41e0-bf1d-dbc1b88c6094 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.637907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.638528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.638817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.639066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.642505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:44.704597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:44.732473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:44.732473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966b0cd-34e5-4c86-9764-1dda537a7169 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:44.741883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1079/2167] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:44.886832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:44.889479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:44.985643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c04e1-d85c-499c-9cd4-a316fa653bda admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:44.991844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:44.996403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:44.996910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:44.997196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] PATH_INFO: `/v3/projects/102dbc9a071648dcb378bf35f6798474` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:44.998794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102dbc9a071648dcb378bf35f6798474)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.000772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.049026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102dbc9a071648dcb378bf35f6798474', 'request_id': 'req-f21a7603-86be-4aa8-9891-d9138589ec45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.054664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102dbc9a071648dcb378bf35f6798474', 'request_id': 'req-f21a7603-86be-4aa8-9891-d9138589ec45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.063604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102dbc9a071648dcb378bf35f6798474', 'request_id': 'req-f21a7603-86be-4aa8-9891-d9138589ec45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.075709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] The token cache is being invalidate because project 102dbc9a071648dcb378bf35f6798474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:45.076068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.076731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.078283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1089/2168] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:44 2022] DELETE /identity/v3/projects/102dbc9a071648dcb378bf35f6798474 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:45.083861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfacde-defd-4079-8232-9d9066bec678 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.084377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfacde-defd-4079-8232-9d9066bec678 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.084466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfacde-defd-4079-8232-9d9066bec678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.105767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c7bfacde-defd-4079-8232-9d9066bec678 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:45.107071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c7bfacde-defd-4079-8232-9d9066bec678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.175831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.177382 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.183188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1080/2169] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:45.192018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.192346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.192709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.192817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a7603-86be-4aa8-9891-d9138589ec45 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.197714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.198480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.198684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.198962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] PATH_INFO: `/v3/users/191d679d1fad45bb8560c9e952c97c45` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.200304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191d679d1fad45bb8560c9e952c97c45)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.202577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.218770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:45.220064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.230559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1081/2170] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:45.235637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.247230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cecaf-1a6c-41d4-8353-6453de288d33 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.252688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.254315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.254600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.254901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.256367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:45.256632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.259762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.275443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1082/2171] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:21:45.276680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191d679d1fad45bb8560c9e952c97c45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.277470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191d679d1fad45bb8560c9e952c97c45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.277991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191d679d1fad45bb8560c9e952c97c45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.279975 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.282625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:45.283774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.300637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93551b-d85f-4d10-a04d-f2b90a792556 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.303277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191d679d1fad45bb8560c9e952c97c45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.307208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.307982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.308174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.308777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.309612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.311666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.325926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ade243f4-8439-4c2b-8205-668afedea9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191d679d1fad45bb8560c9e952c97c45'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:45.346531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1083/2172] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:45.350667 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.353655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1090/2173] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:45 2022] DELETE /identity/v3/users/191d679d1fad45bb8560c9e952c97c45 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:45.359332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.359759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.360170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.386018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:45.387474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.454094 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02248bd-1733-439e-b2fc-33af02395f3f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.466287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1091/2174] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:45.481155 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.483714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.510227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:45.531121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.532338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.532463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.532819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.534116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.537115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.561329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a70b48-5d98-446a-a30d-e348993980f2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.566551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.567257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.567617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.567995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.579068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1084/2175] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:45.579548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.580148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.581111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.592696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1092/2176] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:45.613457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b366-a340-4c49-9a27-db4fef7df2ef admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.621152 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.622089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.622374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.622649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.623311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.633275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.648179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1085/2177] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:45.649983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.663351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85f033-862d-473c-ad9a-a2cb13fd12ba service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.669043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17928b37-4d0d-4348-af9a-5c4ad08a00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.670195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17928b37-4d0d-4348-af9a-5c4ad08a00b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.670692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17928b37-4d0d-4348-af9a-5c4ad08a00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.671168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17928b37-4d0d-4348-af9a-5c4ad08a00b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.672117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17928b37-4d0d-4348-af9a-5c4ad08a00b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.674009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17928b37-4d0d-4348-af9a-5c4ad08a00b5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.688054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1093/2178] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:45.692264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.703397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec756ad-fff5-45b8-b344-03d7eeadeefb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.708815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.709652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.710001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.710345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] PATH_INFO: `/v3/projects/118de5f139f543889dec4689ac99cacc/users/544d088ec12a48e7872fc108bc886d11/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.730155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118de5f139f543889dec4689ac99cacc, user_id=544d088ec12a48e7872fc108bc886d11, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.733249 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:45.756002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1086/2179] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:45 2022] PUT /identity/v3/projects/118de5f139f543889dec4689ac99cacc/users/544d088ec12a48e7872fc108bc886d11/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:45.765572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.765857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.766136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.805941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] MFA Rules not processed for user `544d088ec12a48e7872fc108bc886d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:45.807054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.824614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.827684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:45.869470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:45.921930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1094/2180] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:45.923605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:45.953117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2b9bf-9695-46e1-8dc6-7ad71c697c99 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:45.958976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:45.959622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:45.959903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:45.960228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] PATH_INFO: `/v3/projects/9c122b1498f347a0b90ae97ee867791d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:45.961489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c122b1498f347a0b90ae97ee867791d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:45.963442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.022986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4162-d6a0-4b38-8723-2e8d44375133 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.043082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.043776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.045073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.045376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.046041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.048716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.067544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c122b1498f347a0b90ae97ee867791d', 'request_id': 'req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:46.074318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c122b1498f347a0b90ae97ee867791d', 'request_id': 'req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:46.088110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c122b1498f347a0b90ae97ee867791d', 'request_id': 'req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:46.100511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1095/2181] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:45 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:46.100932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] The token cache is being invalidate because project 9c122b1498f347a0b90ae97ee867791d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:46.101293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:46.102160 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-19a45c75-9dd3-4fea-b3b4-20ce6dc4bf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:46.104134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1087/2182] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:45 2022] DELETE /identity/v3/projects/9c122b1498f347a0b90ae97ee867791d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:46.104573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.109574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.110174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9f40c-ee5d-4d5c-bdab-f945c601b732 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.111259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9f40c-ee5d-4d5c-bdab-f945c601b732 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.111545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9f40c-ee5d-4d5c-bdab-f945c601b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.138555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6bb9f40c-ee5d-4d5c-bdab-f945c601b732 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:46.139798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6bb9f40c-ee5d-4d5c-bdab-f945c601b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.184924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:46.251409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1088/2183] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:46.258592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.258881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.259199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.267003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568c5cb-6530-4322-bb2c-d3020f939b36 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.273321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.274111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.274519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.274898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.275747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.277861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.280266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:46.281527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.290710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1089/2184] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:46.295745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.302461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1096/2185] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:46.307588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a22a41-4dd8-410b-bf96-3fe99c97d4af None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.307799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.315324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.316086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.316357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.316632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.317306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:46.317601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.318773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876ea6-d094-4e9b-81c4-d7f98689b838 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.319379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.329335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.330504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.331002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.332044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.332568 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1090/2186] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:21:46.333465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.335891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.340090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.352950 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d43c3-543e-4146-b9ef-1e6dbbe1dc78 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.356942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1097/2187] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:46.361917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.362216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.362875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.363476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.363602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.364425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.366628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.377097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be56ff-af4c-4ddf-91df-b9842414551b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.394837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.395617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.395941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.396327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] PATH_INFO: `/v3/projects/ecba4516cb524791be22a0f24b54f03b/users/400508ee66ac4d61a453806b3a79594d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.406766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1091/2188] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:46.411171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.414521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecba4516cb524791be22a0f24b54f03b, user_id=400508ee66ac4d61a453806b3a79594d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.418268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.439823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1098/2189] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:46 2022] PUT /identity/v3/projects/ecba4516cb524791be22a0f24b54f03b/users/400508ee66ac4d61a453806b3a79594d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:46.446372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.483216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:46.506810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8204a-296d-456e-b4c9-6e636e8c3dae admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.528947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee280a17-0edf-46c5-8be7-da4ae25769f0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.533765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.534677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.535023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.535299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.536012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.537665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.560132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1099/2190] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:46.561059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.576274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c40bd-6a99-44ce-b040-07bb1538abba admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.583021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35292641-dd79-4efc-9fcd-d37c4fd3f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.583693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35292641-dd79-4efc-9fcd-d37c4fd3f9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.583982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35292641-dd79-4efc-9fcd-d37c4fd3f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.584291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35292641-dd79-4efc-9fcd-d37c4fd3f9f6 admin admin] PATH_INFO: `/v3/projects/ecba4516cb524791be22a0f24b54f03b/users/400508ee66ac4d61a453806b3a79594d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.586406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.587024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.587310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.587581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.588301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.590033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35292641-dd79-4efc-9fcd-d37c4fd3f9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecba4516cb524791be22a0f24b54f03b, user_id=400508ee66ac4d61a453806b3a79594d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.590256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.593406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35292641-dd79-4efc-9fcd-d37c4fd3f9f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.608847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1100/2191] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:46 2022] PUT /identity/v3/projects/ecba4516cb524791be22a0f24b54f03b/users/400508ee66ac4d61a453806b3a79594d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:46.621492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.621782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.622054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.626471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1092/2192] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:46.633183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.645688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da915c-2479-45a3-9939-c09baeab2e09 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.655042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] MFA Rules not processed for user `400508ee66ac4d61a453806b3a79594d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:46.656381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.681088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:46.737475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.738130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.743998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.743998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.743998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.743998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.751883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1093/2193] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:46.756102 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.762374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1101/2194] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:46.766904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085ac00-b904-4b63-9cd9-4ef13b9a55aa admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.772768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.773146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.773540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.773897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.774258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.774567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.775052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.776798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.791949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1094/2195] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:46.796710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.809272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d218c-44c1-4279-a427-ea6e7606fe7a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.815406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f034a46-754a-4f2e-a318-715d0dc7f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.816787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f034a46-754a-4f2e-a318-715d0dc7f136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.817244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f034a46-754a-4f2e-a318-715d0dc7f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.817908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f034a46-754a-4f2e-a318-715d0dc7f136 admin admin] PATH_INFO: `/v3/projects/dcce6400d6c245819a5a67d2eff4920f/users/29ddb65786ac485a96201211e1e2d39d/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.837877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f034a46-754a-4f2e-a318-715d0dc7f136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcce6400d6c245819a5a67d2eff4920f, user_id=29ddb65786ac485a96201211e1e2d39d, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.841077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f034a46-754a-4f2e-a318-715d0dc7f136 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:46.850390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3f47b-30c7-452c-9f1e-18465828f401 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:46.855696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1095/2196] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:46 2022] PUT /identity/v3/projects/dcce6400d6c245819a5a67d2eff4920f/users/29ddb65786ac485a96201211e1e2d39d/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:46.860344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.860634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.860913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.882237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:46.883583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.909951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:46.910616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:46.910896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:46.911171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:46.917767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:46.957982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1096/2197] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:46.967473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:46.968874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:46.989946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:46.992441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:47.008406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1102/2198] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:47.057111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802cd3-d757-4ad5-be8d-4515dec5acb7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:47.061024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d7bd9-5299-4ee9-96b1-303b1ba72a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:47.061733 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d7bd9-5299-4ee9-96b1-303b1ba72a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:47.061904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d7bd9-5299-4ee9-96b1-303b1ba72a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:47.062183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d7bd9-5299-4ee9-96b1-303b1ba72a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:47.075520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d7bd9-5299-4ee9-96b1-303b1ba72a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:47.077474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d7bd9-5299-4ee9-96b1-303b1ba72a3d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:47.099117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1097/2199] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:48.929814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:48.950562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65311eeb-84fd-4ad5-8ff1-07122b3143db service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:48.955786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:48.956600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:48.956951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:48.957225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] PATH_INFO: `/v3/users/544d088ec12a48e7872fc108bc886d11` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:48.958406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544d088ec12a48e7872fc108bc886d11)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:48.960551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:49.077351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544d088ec12a48e7872fc108bc886d11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:49.078081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544d088ec12a48e7872fc108bc886d11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:49.078959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544d088ec12a48e7872fc108bc886d11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:49.109856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544d088ec12a48e7872fc108bc886d11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:49.122684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544d088ec12a48e7872fc108bc886d11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:49.140562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1103/2200] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:48 2022] DELETE /identity/v3/users/544d088ec12a48e7872fc108bc886d11 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:49.145718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:49.146326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:49.146326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:49.166501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:49.168050 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:49.197437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:49.250649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1098/2201] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:49.269056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:49.270785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:49.356952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a18b3-0a63-4b84-a9e7-baa2ed310498 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:49.365111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:49.365793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:49.366081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:49.366359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:49.376941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:49.379608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:49.392613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1104/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:50.037611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:50.039331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:50.059247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4b37-2301-4260-a354-5a211a5b3ab7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:50.075619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:50.076365 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:50.076646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:50.076988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] PATH_INFO: `/v3/projects/118de5f139f543889dec4689ac99cacc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:50.083383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118de5f139f543889dec4689ac99cacc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:50.085645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:50.166451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118de5f139f543889dec4689ac99cacc', 'request_id': 'req-610d6408-db96-47b0-af24-649cce1f9e53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.174577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118de5f139f543889dec4689ac99cacc', 'request_id': 'req-610d6408-db96-47b0-af24-649cce1f9e53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.183625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118de5f139f543889dec4689ac99cacc', 'request_id': 'req-610d6408-db96-47b0-af24-649cce1f9e53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.198621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] The token cache is being invalidate because project 118de5f139f543889dec4689ac99cacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:50.199198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.199909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.204634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1099/2203] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:50 2022] DELETE /identity/v3/projects/118de5f139f543889dec4689ac99cacc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:50.205703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:50.218760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90826ba-c38f-43d2-b0e3-92b28c80b86c service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:50.233964 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:50.305622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:50.306282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:50.306575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:50.306833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] PATH_INFO: `/v3/users/400508ee66ac4d61a453806b3a79594d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:50.308071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=400508ee66ac4d61a453806b3a79594d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:50.310095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:50.413931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400508ee66ac4d61a453806b3a79594d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.414686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400508ee66ac4d61a453806b3a79594d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.416006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400508ee66ac4d61a453806b3a79594d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.435119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400508ee66ac4d61a453806b3a79594d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.447140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c733234d-7c58-46c8-87ca-d780c5f7b7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400508ee66ac4d61a453806b3a79594d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:50.476196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1105/2204] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:21:50 2022] DELETE /identity/v3/users/400508ee66ac4d61a453806b3a79594d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:50.913187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:50.918458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:50.937288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6408-db96-47b0-af24-649cce1f9e53 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.020530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.021175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.021783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.021783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] PATH_INFO: `/v3/projects/ecba4516cb524791be22a0f24b54f03b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.022875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecba4516cb524791be22a0f24b54f03b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.024861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.087784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecba4516cb524791be22a0f24b54f03b', 'request_id': 'req-13234e03-4d2f-4471-9299-c7714e3ad9ff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:51.093163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:51.095186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecba4516cb524791be22a0f24b54f03b', 'request_id': 'req-13234e03-4d2f-4471-9299-c7714e3ad9ff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:51.105944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecba4516cb524791be22a0f24b54f03b', 'request_id': 'req-13234e03-4d2f-4471-9299-c7714e3ad9ff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:51.119415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] The token cache is being invalidate because project ecba4516cb524791be22a0f24b54f03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:21:51.119728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:51.120848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13234e03-4d2f-4471-9299-c7714e3ad9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:21:51.125180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1100/2205] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:21:50 2022] DELETE /identity/v3/projects/ecba4516cb524791be22a0f24b54f03b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:51.127338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.127630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.127939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.151649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:51.152859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:51.256124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1106/2206] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:51.258188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.258596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.258763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.301283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:51.302777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:51.312986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1101/2207] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:51.316864 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:51.327769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c344d1e-1271-4af4-b3d1-5df5fa7331ef None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.337014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.337937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.338403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.338992 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.339847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:21:51.340466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.342411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.357663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1107/2208] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:21:51.362041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:51.377507 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1fe5-1f0d-4a94-acea-4f82a5db266f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.384919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.385921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.386353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.386785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.387639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.389769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.454754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1102/2209] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:51 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:51.461186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:51.474448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403f24a-c9d8-423d-b0e1-3ee699161bd9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.504344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:51.568087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.568813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.569167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.570084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.570215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.572876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.608148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1108/2210] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:51 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:51.610088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:51.625127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faffb13-24e8-4217-bd91-d793f8c750f2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.630615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.631272 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.631556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.631833 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.632524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.634138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.650804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1103/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:51.654789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:51.665168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42fa8-a3e2-471a-a7e7-ac26d49009e3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.670093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30eb01-d40f-4f4f-bc55-65a6fdd58006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.670860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30eb01-d40f-4f4f-bc55-65a6fdd58006 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.671108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30eb01-d40f-4f4f-bc55-65a6fdd58006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.671443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30eb01-d40f-4f4f-bc55-65a6fdd58006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.672583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30eb01-d40f-4f4f-bc55-65a6fdd58006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.673991 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30eb01-d40f-4f4f-bc55-65a6fdd58006 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.688814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1109/2212] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:51.696010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:51.707026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03e4ce-9466-4aec-b2dd-aa337e1f154d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:51.712640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:51.713396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.713885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.714236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] PATH_INFO: `/v3/projects/41a4a2ace02e48e3bc2fd1787c32af43/users/68ca6f5880104175a4d0bd780c11a464/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.736791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a4a2ace02e48e3bc2fd1787c32af43, user_id=68ca6f5880104175a4d0bd780c11a464, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:51.742930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:51.774587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1104/2213] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:51 2022] PUT /identity/v3/projects/41a4a2ace02e48e3bc2fd1787c32af43/users/68ca6f5880104175a4d0bd780c11a464/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:51.789840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:51.790151 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:51.790397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:51.834963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] MFA Rules not processed for user `68ca6f5880104175a4d0bd780c11a464`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:51.836234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:51.962128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1110/2214] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:51.965883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.048745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b404-8f11-4812-b95c-45d04a3e2a59 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.054896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.056826 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.057167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.057543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.058367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.060504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.102476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1105/2215] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:51 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:52.106717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.119068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730659b-60b8-46fb-9461-318ac3925107 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.214729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.215462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.215714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.216268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.217246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.219288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.265839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1111/2216] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:52.269931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.286516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf8b0-347f-4a3f-9f0c-bae5a46ea650 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.292836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.293900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.294591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.295017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.295885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.298122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.329918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.336161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1106/2217] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:52.346002 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a019db1-b887-4948-8885-598000a97293 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.354217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e465-d811-48fe-95e6-767a510f4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.354853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e465-d811-48fe-95e6-767a510f4d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.355135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e465-d811-48fe-95e6-767a510f4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.355407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e465-d811-48fe-95e6-767a510f4d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.356106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374e465-d811-48fe-95e6-767a510f4d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.357740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374e465-d811-48fe-95e6-767a510f4d33 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.372993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1112/2218] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:52.374877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.387488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88e75-68ac-4420-b8b1-8a2dd2968d77 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.393019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f19be-cd54-464c-a682-f80b28436b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.394729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f19be-cd54-464c-a682-f80b28436b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.395166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f19be-cd54-464c-a682-f80b28436b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.395464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f19be-cd54-464c-a682-f80b28436b32 admin admin] PATH_INFO: `/v3/projects/fe3d6983652c4a1385dfd58e96333538/users/820931670e8a49bf87c90a562b9a495a/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.414904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f19be-cd54-464c-a682-f80b28436b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3d6983652c4a1385dfd58e96333538, user_id=820931670e8a49bf87c90a562b9a495a, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.417874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f19be-cd54-464c-a682-f80b28436b32 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.435213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1107/2219] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:52 2022] PUT /identity/v3/projects/fe3d6983652c4a1385dfd58e96333538/users/820931670e8a49bf87c90a562b9a495a/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:52.446795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.447147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.447441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.489870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.490166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.490439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.493516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:52.503564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] MFA Rules not processed for user `820931670e8a49bf87c90a562b9a495a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:52.504885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:52.528744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] MFA Rules not processed for user `29ddb65786ac485a96201211e1e2d39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:52.530088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:52.557483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:52.578104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1113/2220] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:52.582887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.631288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1108/2221] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:52.636512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.637901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:52.666852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6ab5-b8ee-4f48-9ee4-07f9b856d16b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.672281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.673302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.673657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.674274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.674843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.677056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.713274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41a80-6918-4f91-8bdb-d0d4fade025b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.714672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1114/2222] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:52.718875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.811126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af114d-0bb4-48c8-838f-4c68e1e46829 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.817644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.818386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.818767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.819158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.819897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.822108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.828597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.829277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.829559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.829848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.830629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.832928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:52.859535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1115/2223] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:21:52.865917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.876813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1109/2224] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:52.880813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:52.880973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1fd2-eddd-4f06-b9f9-6125f5cdd684 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:52.905226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:52.975548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:52.976625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:52.977404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:52.977926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:52.979014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:52.982175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.001040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1116/2225] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:53.005433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:53.006888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.023291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0380f-6d61-4a8f-9ad1-4aadcec2b9b3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.032250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.033031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.033388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.033827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] PATH_INFO: `/v3/projects/00561bbdd8fc46129753f716e2b05426/users/5740b4c83610471d9b6390432c3b7ac6/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.065934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499c89-b6a0-42b7-b7db-0e2222c8477b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.068157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=00561bbdd8fc46129753f716e2b05426, user_id=5740b4c83610471d9b6390432c3b7ac6, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.074505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.094655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.095297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.095583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.095862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.097196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.099179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.107015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1117/2226] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:53 2022] PUT /identity/v3/projects/00561bbdd8fc46129753f716e2b05426/users/5740b4c83610471d9b6390432c3b7ac6/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:53.108239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.148766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1110/2227] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:21:52 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:21:53.157208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.210646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82ca4-b33c-4b14-801e-9e73c6e45b5b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.274914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc203-6930-45d0-b9f8-10046dea63aa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.290189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.290887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.291182 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.291464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.292386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.294874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.314856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1118/2228] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:53.319698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.335752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596efc9-a930-4751-bfd2-2668ad028899 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.336084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.336534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.336692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.336964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.337616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.339253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.342032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10913da-e836-4b3f-9ec5-8de8d718d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.342938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10913da-e836-4b3f-9ec5-8de8d718d605 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.343435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10913da-e836-4b3f-9ec5-8de8d718d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.343943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10913da-e836-4b3f-9ec5-8de8d718d605 admin admin] PATH_INFO: `/v3/projects/00561bbdd8fc46129753f716e2b05426/users/5740b4c83610471d9b6390432c3b7ac6/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.350012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10913da-e836-4b3f-9ec5-8de8d718d605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00561bbdd8fc46129753f716e2b05426, user_id=5740b4c83610471d9b6390432c3b7ac6, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.352140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1111/2229] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:21:53.354404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10913da-e836-4b3f-9ec5-8de8d718d605 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.355554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.370273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524bbf4-bc91-467e-9b01-d17a494fbf2a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.405325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1119/2230] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:53 2022] PUT /identity/v3/projects/00561bbdd8fc46129753f716e2b05426/users/5740b4c83610471d9b6390432c3b7ac6/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:53.406836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.407338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.407704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.451624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] MFA Rules not processed for user `5740b4c83610471d9b6390432c3b7ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:53.452996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:53.464451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.465137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.465420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.465702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] PATH_INFO: `/v3/projects/beb1e2f2895247b0b9178c2409a2297d/users/5f4546adc4cf4a8ba115b5743d19443c/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.486136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb1e2f2895247b0b9178c2409a2297d, user_id=5f4546adc4cf4a8ba115b5743d19443c, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.489128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.505567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1112/2231] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:53 2022] PUT /identity/v3/projects/beb1e2f2895247b0b9178c2409a2297d/users/5f4546adc4cf4a8ba115b5743d19443c/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:21:53.509986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.529070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:53.543472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1120/2232] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:21:53.556759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.558261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:53.590367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a7d9f-727b-485b-afac-416e7b2c8977 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.595760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.596724 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.597005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.597323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.598162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.599781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.602398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:53.617438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1113/2233] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:21:53.618525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:53.626865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40346b-385a-4997-97e5-39b16e6c7231 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.631419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df141192-f185-4c9a-b4bd-89232c148e7f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:53.644870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.645841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.646273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.646732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] PATH_INFO: `/v3/projects/beb1e2f2895247b0b9178c2409a2297d/users/5f4546adc4cf4a8ba115b5743d19443c/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.650795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb1e2f2895247b0b9178c2409a2297d, user_id=5f4546adc4cf4a8ba115b5743d19443c, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.654164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.666902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1114/2234] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:21:53 2022] PUT /identity/v3/projects/beb1e2f2895247b0b9178c2409a2297d/users/5f4546adc4cf4a8ba115b5743d19443c/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:21:53.698004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ade86-2688-4c83-aed3-376ff5d9df34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:53.698658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ade86-2688-4c83-aed3-376ff5d9df34 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:53.698985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ade86-2688-4c83-aed3-376ff5d9df34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:53.699272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ade86-2688-4c83-aed3-376ff5d9df34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:53.801427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ade86-2688-4c83-aed3-376ff5d9df34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:53.802912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ade86-2688-4c83-aed3-376ff5d9df34 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:53.813294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1121/2235] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:54.711247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:54.800319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66841b-eae1-4ebf-abb8-2ebfe361f583 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:54.804537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:54.805351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:54.805775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:54.806192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:54.880255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:54.881740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:54.891011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1115/2236] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:21:59.405200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:59.405200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:59.406054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:59.438848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] MFA Rules not processed for user `5f4546adc4cf4a8ba115b5743d19443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:21:59.440752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:59.474642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:59.484509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43525e6d-c27b-467e-8c2c-5b82bd70b53b service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:59.488352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f84de-3f96-4506-be2a-07554606d131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:59.488972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f84de-3f96-4506-be2a-07554606d131 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:59.489252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f84de-3f96-4506-be2a-07554606d131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:59.489699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f84de-3f96-4506-be2a-07554606d131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:59.510015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:59.539902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1122/2237] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:21:59.553041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:21:59.554474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:21:59.571665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f84de-3f96-4506-be2a-07554606d131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:59.573389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f84de-3f96-4506-be2a-07554606d131 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:59.608268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1116/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:21:59.666191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff16c1-ae66-422b-bd43-d881ab9d5441 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:21:59.675395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:21:59.676195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:21:59.676474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:21:59.678005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:21:59.810201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:21:59.812006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:21:59.837909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1123/2239] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:00.078948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:00.079460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:00.079777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:00.127382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:00.131802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:00.191485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:00.242358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1117/2240] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:00.287176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:00.290614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:00.416847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdf17-3e28-4b66-8c76-035e60fe594a service glance] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:00.426445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a668d0-8e35-415a-80fd-91366b23bdc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:00.427078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a668d0-8e35-415a-80fd-91366b23bdc1 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:00.427361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a668d0-8e35-415a-80fd-91366b23bdc1 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:00.427633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a668d0-8e35-415a-80fd-91366b23bdc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:00.440735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a668d0-8e35-415a-80fd-91366b23bdc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:00.443077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a668d0-8e35-415a-80fd-91366b23bdc1 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:00.459333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1124/2241] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:22:03.196958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:03.383354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1d7fd-7131-4e1e-aea2-0d074e393f09 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:03.394656 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:03.396379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:03.397020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:03.397310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] PATH_INFO: `/v3/users/68ca6f5880104175a4d0bd780c11a464` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:03.400270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ca6f5880104175a4d0bd780c11a464)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:03.403813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:03.521073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ca6f5880104175a4d0bd780c11a464'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:03.538042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ca6f5880104175a4d0bd780c11a464'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:03.540542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ca6f5880104175a4d0bd780c11a464'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:03.574474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ca6f5880104175a4d0bd780c11a464'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:03.606969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe65a9a4-c6d4-45fe-9106-dcb6c1ae9e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ca6f5880104175a4d0bd780c11a464'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:03.623707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1118/2242] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:03 2022] DELETE /identity/v3/users/68ca6f5880104175a4d0bd780c11a464 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:03.626048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:03.626587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:03.626587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:03.673697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68331b8-991b-44b7-a704-085fb71479af None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:03.674500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68331b8-991b-44b7-a704-085fb71479af None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:03.674780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68331b8-991b-44b7-a704-085fb71479af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:03.702617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:03.708029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:03.739600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f68331b8-991b-44b7-a704-085fb71479af None None] MFA Rules not processed for user `bd1bab7e87ff435da29d6abf2fd9d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:03.741736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f68331b8-991b-44b7-a704-085fb71479af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:03.764457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:03.838950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1125/2243] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:03.849905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:03.851676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:03.893106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1119/2244] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:04.012095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4a61-e42a-414a-b2c2-65a6f73ade23 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:04.025324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:04.025811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:04.026111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:04.026369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:04.045299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:04.047304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:04.071239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1126/2245] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:04.712176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68331b8-991b-44b7-a704-085fb71479af None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:04.714598 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f68331b8-991b-44b7-a704-085fb71479af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:04.778299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68331b8-991b-44b7-a704-085fb71479af None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:04.796761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:04.799795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:04.800133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:04.800412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] PATH_INFO: `/v3/projects/41a4a2ace02e48e3bc2fd1787c32af43` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:04.806302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a4a2ace02e48e3bc2fd1787c32af43)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:04.808472 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:04.829418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:04.968126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a4a2ace02e48e3bc2fd1787c32af43', 'request_id': 'req-454120e3-6a9f-4cd0-8cfa-7df3d6945192'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:04.989125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a4a2ace02e48e3bc2fd1787c32af43', 'request_id': 'req-454120e3-6a9f-4cd0-8cfa-7df3d6945192'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.055735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a4a2ace02e48e3bc2fd1787c32af43', 'request_id': 'req-454120e3-6a9f-4cd0-8cfa-7df3d6945192'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.088937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] The token cache is being invalidate because project 41a4a2ace02e48e3bc2fd1787c32af43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:05.089599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.093466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.097845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1120/2246] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:04 2022] DELETE /identity/v3/projects/41a4a2ace02e48e3bc2fd1787c32af43 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:05.101817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:05.118844 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afa65-8172-4d7f-ae7f-a18176afb1ae service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:05.322350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:05.325629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:05.328371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:05.328756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] PATH_INFO: `/v3/users/820931670e8a49bf87c90a562b9a495a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:05.340792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820931670e8a49bf87c90a562b9a495a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:05.342930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:05.463618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820931670e8a49bf87c90a562b9a495a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.464367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820931670e8a49bf87c90a562b9a495a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.465520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820931670e8a49bf87c90a562b9a495a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.506982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820931670e8a49bf87c90a562b9a495a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.543662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820931670e8a49bf87c90a562b9a495a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:05.550101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:05.588792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1127/2247] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:05 2022] DELETE /identity/v3/users/820931670e8a49bf87c90a562b9a495a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:06.456385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:06.458577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:06.482011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454120e3-6a9f-4cd0-8cfa-7df3d6945192 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:06.552941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:06.553868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:06.554367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:06.554839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] PATH_INFO: `/v3/projects/fe3d6983652c4a1385dfd58e96333538` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:06.557054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3d6983652c4a1385dfd58e96333538)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:06.559840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:06.657057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3d6983652c4a1385dfd58e96333538', 'request_id': 'req-6e11fec2-9cfb-405f-bffb-2f599a7320fa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:06.670758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3d6983652c4a1385dfd58e96333538', 'request_id': 'req-6e11fec2-9cfb-405f-bffb-2f599a7320fa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:06.685768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3d6983652c4a1385dfd58e96333538', 'request_id': 'req-6e11fec2-9cfb-405f-bffb-2f599a7320fa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:06.712243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] The token cache is being invalidate because project fe3d6983652c4a1385dfd58e96333538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:06.712540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:06.715078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:06.718818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1121/2248] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:06 2022] DELETE /identity/v3/projects/fe3d6983652c4a1385dfd58e96333538 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:06.723165 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:06.724694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:06.744914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d93ea9-6476-4b53-b051-a293bfcb9ae8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:06.950006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:06.951281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:06.952673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:06.964488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] PATH_INFO: `/v3/users/5740b4c83610471d9b6390432c3b7ac6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:06.964488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5740b4c83610471d9b6390432c3b7ac6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:06.965110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:07.073189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5740b4c83610471d9b6390432c3b7ac6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:07.075134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5740b4c83610471d9b6390432c3b7ac6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:07.076913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5740b4c83610471d9b6390432c3b7ac6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:07.109160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5740b4c83610471d9b6390432c3b7ac6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:07.131835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dacb9f24-18cb-4eec-bfe1-e9247af2fd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5740b4c83610471d9b6390432c3b7ac6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:07.169444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1128/2249] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:06 2022] DELETE /identity/v3/users/5740b4c83610471d9b6390432c3b7ac6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:07.817690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:07.819327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:07.834768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11fec2-9cfb-405f-bffb-2f599a7320fa admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:07.858267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:07.924200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:07.925503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:07.925915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:07.926415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] PATH_INFO: `/v3/projects/00561bbdd8fc46129753f716e2b05426` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:07.935276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00561bbdd8fc46129753f716e2b05426)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:07.938137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:08.038887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00561bbdd8fc46129753f716e2b05426', 'request_id': 'req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:08.050270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00561bbdd8fc46129753f716e2b05426', 'request_id': 'req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:08.064206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00561bbdd8fc46129753f716e2b05426', 'request_id': 'req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:08.078608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] The token cache is being invalidate because project 00561bbdd8fc46129753f716e2b05426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:08.079278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:08.080771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9e46b41b-46d4-46cb-8bd4-0c55dccb6a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:08.089785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1122/2250] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:07 2022] DELETE /identity/v3/projects/00561bbdd8fc46129753f716e2b05426 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:08.091327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.092219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.092700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.126972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:08.129168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:08.269295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1129/2251] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:08.280251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.280251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.280540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.322488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:08.324041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:08.340747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:08.347535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1123/2252] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:08.352257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa5206-b4eb-4540-8966-5b0511eb7206 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:08.357934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:08.358832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.359291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.360167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.361729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:22:08.362195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:08.364082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:08.389748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:08.390548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1130/2253] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:22:08.400696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:08.448623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50eb96-0c41-4ff3-bfb6-e88c15ea4137 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:08.478916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:08.488046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.488360 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.488637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.489307 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:08.499653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:08.643725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1124/2254] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:08 2022] POST /identity/v3/projects => generated 389 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:08.646045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:08.669695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639641ed-9f48-48ae-98be-90306ee199e8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:08.750771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:08.752032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.752502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.753815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.754590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:08.756723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:08.833229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:08.845512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1131/2255] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:08 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:08.851483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee823227-40cc-4388-9c60-2216d9a5a0de admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:08.860725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:08.862208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.862595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.862972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.864490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:08.866762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:08.885591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:08.891535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1125/2256] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:22:08.901821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e6a4-888e-483d-8b3b-4ea95aa54583 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:08.909645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ac0ee-b60a-4edf-8568-4de7c3df0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:08.910531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ac0ee-b60a-4edf-8568-4de7c3df0e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.910905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ac0ee-b60a-4edf-8568-4de7c3df0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.911279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ac0ee-b60a-4edf-8568-4de7c3df0e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:08.912409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ac0ee-b60a-4edf-8568-4de7c3df0e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:08.916875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ac0ee-b60a-4edf-8568-4de7c3df0e7c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:08.958631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1132/2257] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:08.964538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:08.981185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26624-26cf-4b48-9cde-d4c1a483566c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:08.995809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:08.996629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:08.997140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:08.997629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] PATH_INFO: `/v3/projects/f1bb7dce0f0c4bcc9f0587e5a1e63aab/users/e95662007e984b229fb51af08bb00e65/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.038304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bb7dce0f0c4bcc9f0587e5a1e63aab, user_id=e95662007e984b229fb51af08bb00e65, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.041563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.064969 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1126/2258] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:08 2022] PUT /identity/v3/projects/f1bb7dce0f0c4bcc9f0587e5a1e63aab/users/e95662007e984b229fb51af08bb00e65/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:09.079367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.080041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.080441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.116849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] MFA Rules not processed for user `e95662007e984b229fb51af08bb00e65`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:09.118205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:09.221816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1133/2259] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:09.225486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:09.304009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:09.326546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a520-aee4-40aa-8f26-6012013ec78c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:09.333278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:09.334492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.334492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.336348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.336348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.337951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.378114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:09.384090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1127/2260] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:09 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:09.390657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0fb91-cd38-46d1-b9b3-a3b85fb2d0c7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:09.468128 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:09.470705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.471073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.471410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.472185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.474370 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.500708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:09.513437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1134/2261] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:09 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:09.514471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:09.531427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d57c2-4d7c-4655-99a9-97f370b196e3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:09.542751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:09.543417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.545158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.546464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.547229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.549310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.565907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1128/2262] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:22:09.570459 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:09.584108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c51c5-8440-4b6a-9198-074a8cbab7e3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:09.598790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:09.599815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.600267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.601039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] PATH_INFO: `/v3/projects/a1bd8ec4bceb4c99bd341eb0dca4ab83/users/123da367f4ab4c008687dbee347186d6/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.637611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bd8ec4bceb4c99bd341eb0dca4ab83, user_id=123da367f4ab4c008687dbee347186d6, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.640816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.661438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1135/2263] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:09 2022] PUT /identity/v3/projects/a1bd8ec4bceb4c99bd341eb0dca4ab83/users/123da367f4ab4c008687dbee347186d6/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:09.665934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:09.698717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6459a-2f2b-4711-9201-8fe8d3dbf6c8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:09.869397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e865a-be70-497c-95df-239bc8684015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:09.871254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e865a-be70-497c-95df-239bc8684015 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.872418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e865a-be70-497c-95df-239bc8684015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.873548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e865a-be70-497c-95df-239bc8684015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.874505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e865a-be70-497c-95df-239bc8684015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.888489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e865a-be70-497c-95df-239bc8684015 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.905178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1129/2264] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:09.908707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:09.922570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1db09-ad49-4ad7-98c9-86caf46fde45 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:09.930319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:09.930999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.931536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.932079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] PATH_INFO: `/v3/projects/a1bd8ec4bceb4c99bd341eb0dca4ab83/users/123da367f4ab4c008687dbee347186d6/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.938321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bd8ec4bceb4c99bd341eb0dca4ab83, user_id=123da367f4ab4c008687dbee347186d6, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:09.941376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:09.954282 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1136/2265] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:09 2022] PUT /identity/v3/projects/a1bd8ec4bceb4c99bd341eb0dca4ab83/users/123da367f4ab4c008687dbee347186d6/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:22:09.966306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:09.966306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:09.966306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:09.997873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] MFA Rules not processed for user `123da367f4ab4c008687dbee347186d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:09.999566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:10.140980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:10.142857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1130/2266] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:10.143680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:10.248273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db315b56-eea1-4197-a357-65564e988817 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:10.253514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03f3d-81dd-4a6e-b012-c5494262d01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:10.255286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03f3d-81dd-4a6e-b012-c5494262d01c service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:10.255286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03f3d-81dd-4a6e-b012-c5494262d01c service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:10.255286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03f3d-81dd-4a6e-b012-c5494262d01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:10.268447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa03f3d-81dd-4a6e-b012-c5494262d01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:10.270045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa03f3d-81dd-4a6e-b012-c5494262d01c service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:10.284329 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1137/2267] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:10.501142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:10.606052 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:10.650258 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c2e0b-2497-48c0-8e75-d82b7825a4cc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:10.662660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:10.662660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:10.662660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:10.662660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] PATH_INFO: `/v3/users/e95662007e984b229fb51af08bb00e65` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:10.663369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95662007e984b229fb51af08bb00e65)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:10.675615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:10.794233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95662007e984b229fb51af08bb00e65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:10.816789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95662007e984b229fb51af08bb00e65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:10.818943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95662007e984b229fb51af08bb00e65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:10.871563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95662007e984b229fb51af08bb00e65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:10.880629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95662007e984b229fb51af08bb00e65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:10.890980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1131/2268] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:10 2022] DELETE /identity/v3/users/e95662007e984b229fb51af08bb00e65 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:10.896585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:10.897166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:10.897825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:10.944319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:10.948067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:11.090579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1138/2269] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:11.113227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:11.116772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:11.206881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faf1af-572e-49e7-80d7-b48a44ef6dd2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:11.212088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:11.213232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:11.214693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:11.215059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:11.231827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:11.235349 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:11.258183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1132/2270] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:11.908510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:11.910582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:11.928307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c5b34-6675-42a2-ba1b-a944dbdae958 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:11.933272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:11.933969 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:11.934254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:11.934529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] PATH_INFO: `/v3/users/4a54a6878c3d4dca9a1f7b078a5fee1d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:11.935737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a54a6878c3d4dca9a1f7b078a5fee1d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:11.937787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:12.006324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:12.009143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:12.035407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a54a6878c3d4dca9a1f7b078a5fee1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.041495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a54a6878c3d4dca9a1f7b078a5fee1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.042688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a54a6878c3d4dca9a1f7b078a5fee1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.055729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fbcc1-32ed-4925-8e24-fd52bf25fb04 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:12.068078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:12.069128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:12.071470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:12.072284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:12.073558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] PATH_INFO: `/v3/projects/f1bb7dce0f0c4bcc9f0587e5a1e63aab` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:12.076914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bb7dce0f0c4bcc9f0587e5a1e63aab)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:12.080020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a54a6878c3d4dca9a1f7b078a5fee1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.085546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:12.102473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58bc835-e522-4755-a9a7-17d306275d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a54a6878c3d4dca9a1f7b078a5fee1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.140878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1139/2271] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:11 2022] DELETE /identity/v3/users/4a54a6878c3d4dca9a1f7b078a5fee1d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:12.144389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:12.144689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:12.144974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:12.187174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:12.188160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:12.219903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bb7dce0f0c4bcc9f0587e5a1e63aab', 'request_id': 'req-5d6c9b30-34c8-4788-b13d-1c4155b2684b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.230364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bb7dce0f0c4bcc9f0587e5a1e63aab', 'request_id': 'req-5d6c9b30-34c8-4788-b13d-1c4155b2684b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.234136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:12.246318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bb7dce0f0c4bcc9f0587e5a1e63aab', 'request_id': 'req-5d6c9b30-34c8-4788-b13d-1c4155b2684b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.266910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] The token cache is being invalidate because project f1bb7dce0f0c4bcc9f0587e5a1e63aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:12.267934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.268853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.271010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1133/2272] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:12 2022] DELETE /identity/v3/projects/f1bb7dce0f0c4bcc9f0587e5a1e63aab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:12.275099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:12.276736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:12.291454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1140/2273] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:12.301427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:12.303013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:12.375491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c9b30-34c8-4788-b13d-1c4155b2684b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:12.383412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:12.384412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:12.384882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:12.385684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] PATH_INFO: `/v3/users/123da367f4ab4c008687dbee347186d6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:12.387453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] RBAC: Authorizing `identity:delete_user(user_id=123da367f4ab4c008687dbee347186d6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:12.389811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:12.407326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e50cfd-484f-4929-9f3e-ca971b4555bf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:12.413790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c8ede-d6bc-4b68-835e-cc46ed6e8f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:12.414496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8ede-d6bc-4b68-835e-cc46ed6e8f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:12.414845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8ede-d6bc-4b68-835e-cc46ed6e8f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:12.415184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8ede-d6bc-4b68-835e-cc46ed6e8f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:12.430899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8ede-d6bc-4b68-835e-cc46ed6e8f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:12.432620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8ede-d6bc-4b68-835e-cc46ed6e8f67 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:12.445996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1141/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:22:12.447500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:12.454276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:12.455162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:12.458589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123da367f4ab4c008687dbee347186d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.468897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123da367f4ab4c008687dbee347186d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.469854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123da367f4ab4c008687dbee347186d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.483276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] MFA Rules not processed for user `b5872d0410214dd6b44c36c7952a5ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:12.485248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:12.490604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123da367f4ab4c008687dbee347186d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.504800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123da367f4ab4c008687dbee347186d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:12.522475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1134/2275] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:12 2022] DELETE /identity/v3/users/123da367f4ab4c008687dbee347186d6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:12.611993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1142/2276] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:13.134680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:13.138264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:13.316527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736605ac-5c16-4190-877d-6d9691fc81de admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:13.328887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:13.330247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.330591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.330869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] PATH_INFO: `/v3/projects/8b303ea1fcb0418fbd8f9c46903384b3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.334875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b303ea1fcb0418fbd8f9c46903384b3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:13.337385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:13.342646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:13.344240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:13.382080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:13.382289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e225c-581a-454e-8689-37a4d4514aa7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:13.402771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:13.403221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.403485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.410324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] PATH_INFO: `/v3/projects/a1bd8ec4bceb4c99bd341eb0dca4ab83` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.415027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bd8ec4bceb4c99bd341eb0dca4ab83)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:13.420074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:13.478007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:13.496564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b303ea1fcb0418fbd8f9c46903384b3', 'request_id': 'req-e403d517-5025-41d5-bde7-1da08894ce87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.513110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b303ea1fcb0418fbd8f9c46903384b3', 'request_id': 'req-e403d517-5025-41d5-bde7-1da08894ce87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.530469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b303ea1fcb0418fbd8f9c46903384b3', 'request_id': 'req-e403d517-5025-41d5-bde7-1da08894ce87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.545772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bd8ec4bceb4c99bd341eb0dca4ab83', 'request_id': 'req-b5832e9c-2107-4f22-8549-604a92448ff8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.555125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] The token cache is being invalidate because project 8b303ea1fcb0418fbd8f9c46903384b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:13.555801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.556832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bd8ec4bceb4c99bd341eb0dca4ab83', 'request_id': 'req-b5832e9c-2107-4f22-8549-604a92448ff8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.557488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e403d517-5025-41d5-bde7-1da08894ce87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.561466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1135/2277] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:13 2022] DELETE /identity/v3/projects/8b303ea1fcb0418fbd8f9c46903384b3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:13.566740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2fb2-bab1-45a6-8e02-0abb614a1e41 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.567065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2fb2-bab1-45a6-8e02-0abb614a1e41 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.567306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2fb2-bab1-45a6-8e02-0abb614a1e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.573624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bd8ec4bceb4c99bd341eb0dca4ab83', 'request_id': 'req-b5832e9c-2107-4f22-8549-604a92448ff8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.601100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] The token cache is being invalidate because project a1bd8ec4bceb4c99bd341eb0dca4ab83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:13.602614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.603423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5832e9c-2107-4f22-8549-604a92448ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:13.610521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1143/2278] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:13 2022] DELETE /identity/v3/projects/a1bd8ec4bceb4c99bd341eb0dca4ab83 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:13.613617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2fe34-0590-49ca-b3d5-6290991ad85b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.613888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2fe34-0590-49ca-b3d5-6290991ad85b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.614170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2fe34-0590-49ca-b3d5-6290991ad85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.617907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d6cc2fb2-bab1-45a6-8e02-0abb614a1e41 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:13.619203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6cc2fb2-bab1-45a6-8e02-0abb614a1e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:13.643469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dcd2fe34-0590-49ca-b3d5-6290991ad85b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:13.644904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dcd2fe34-0590-49ca-b3d5-6290991ad85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:13.741254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1136/2279] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:13.749803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.750141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.750430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.793093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1144/2280] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:13.798385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:13.799152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.799523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.799805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.801784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:13.828920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1137/2281] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:22:13.830600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:13.850090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:13.851397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:13.854380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09c67c-9b35-4179-ae5f-fc6649bc022e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:13.862475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:13.863122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.863484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.863769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.864582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:22:13.864892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:13.866665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:13.886409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1145/2282] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:13.887860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:13.894099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1138/2283] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:22:13.894879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:13.898634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34407-d6fe-4b89-9f3d-cdfa44dc78bf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:13.905303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:13.906459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf73471-40a2-40de-b969-02b7d7c0461f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:13.906577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.907131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.907615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.908527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:22:13.909047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:13.910857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:13.911660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:13.912388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.912610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.912888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.913552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:13.916043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:13.931376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1146/2284] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:22:13.932700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:13.946369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d93ed-cf28-46a7-9a0a-09db97ff7c6f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:13.955697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:13.957493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:13.957990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:13.958655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:13.959699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:13.962745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:13.977477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1139/2285] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:13.986585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.007477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1147/2286] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:14.009320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.100296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1174df-a39f-42c2-a98a-c1f55246f603 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.106733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.106733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.107078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.107437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.108212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.111241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.123779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:14.151689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:14.152302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1148/2287] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:14 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:14.157713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.171031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffef390-a178-4dc6-9fdf-1df518de98b4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.181137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3637e-144b-4d23-9713-e4fa014b5eab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.184672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.185440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.185818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.187087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.190445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.192867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.197785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.198791 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.200341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.200808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.201654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.216668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.231288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1140/2288] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:13 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:14.235252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.238395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1149/2289] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:14.241515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.251099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668ed2c-bc03-414e-a1a9-0642556311da admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.258640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.259549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.259728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f544d83-c3d7-4427-8dc3-afd1c5908f71 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.260035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.260403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.261500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.263688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.269355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.270682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.271114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.272031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.272881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.274971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.277109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1141/2290] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:14.287498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.288385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1150/2291] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:22:14.294063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.303782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d957b7-5d78-4f98-8c79-bfa1ddec1ba1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.310442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.311234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.311631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.312076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.312997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.315346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.318681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69af7e-17fb-41fb-ae05-a7cbe002ce09 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.331020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1142/2292] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:14.332587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.334533 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d45cb-7910-4c88-8ceb-1918f7c743b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.335407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d45cb-7910-4c88-8ceb-1918f7c743b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.335784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d45cb-7910-4c88-8ceb-1918f7c743b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.336194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d45cb-7910-4c88-8ceb-1918f7c743b0 admin admin] PATH_INFO: `/v3/projects/7d0d6c20d5284f2ba451aedc7ade9a46/users/9fd97f61e90341dcba95aa08d80cd294/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.346558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecd43-8bb7-40e3-8902-9545af9afb49 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.356625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d45cb-7910-4c88-8ceb-1918f7c743b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0d6c20d5284f2ba451aedc7ade9a46, user_id=9fd97f61e90341dcba95aa08d80cd294, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.358186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450a5a-956d-4efa-aa42-935c03fee91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.360147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d45cb-7910-4c88-8ceb-1918f7c743b0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.360297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450a5a-956d-4efa-aa42-935c03fee91f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.360439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450a5a-956d-4efa-aa42-935c03fee91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.360789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450a5a-956d-4efa-aa42-935c03fee91f admin admin] PATH_INFO: `/v3/projects/7dcc237f8885415685fe3f29c39e3dc1/users/1a4bc17bcc944036a98b6c3e5a1cd262/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.384374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1151/2293] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:14 2022] PUT /identity/v3/projects/7d0d6c20d5284f2ba451aedc7ade9a46/users/9fd97f61e90341dcba95aa08d80cd294/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:14.396339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.396628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.396935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.405338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d450a5a-956d-4efa-aa42-935c03fee91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dcc237f8885415685fe3f29c39e3dc1, user_id=1a4bc17bcc944036a98b6c3e5a1cd262, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.407048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d450a5a-956d-4efa-aa42-935c03fee91f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.440565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1143/2294] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:14 2022] PUT /identity/v3/projects/7dcc237f8885415685fe3f29c39e3dc1/users/1a4bc17bcc944036a98b6c3e5a1cd262/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:14.451366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.453227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.453841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.460509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] MFA Rules not processed for user `9fd97f61e90341dcba95aa08d80cd294`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:14.461986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:14.503759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] MFA Rules not processed for user `1a4bc17bcc944036a98b6c3e5a1cd262`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:14.505277 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:14.587913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1144/2295] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:22:14.605821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.608275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:14.628605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1152/2296] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:14.633314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:14.777271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922ad8-2d18-4d4a-9fa7-284172b96420 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.844493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f5c18-2212-4244-9f2d-d83e31aec088 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:14.847818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.848841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.849508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.849999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.850336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:14.850982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:14.851314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:14.851637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.851753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:14.855563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.876858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:14.876858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:14.891411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1145/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:14.974714 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1153/2298] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:14 2022] POST /identity/v3/projects => generated 365 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:14.980339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:15.011913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f976-68f0-4658-ae45-9bbbaca687bc service glance] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:15.051558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:15.120719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:15.121521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:15.121902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:15.122270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:15.123010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:15.125068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:15.204162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1146/2299] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:14 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:15.206195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:15.230886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98df70-9776-452a-b48b-a5998db8c983 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:15.252828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:15.253989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:15.254511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:15.255506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:15.256943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:15.262567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:15.293251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1154/2300] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:15.299920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:15.316743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c9ce1-76fb-407b-9eb1-58a49363cd49 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:15.330489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:15.331390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:15.333447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:15.333813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] PATH_INFO: `/v3/projects/9aef5cabce364fc9bd9c8ee1cbab8867/users/ad98d538a2914fc2b757f262c7e38926/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:15.404935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aef5cabce364fc9bd9c8ee1cbab8867, user_id=ad98d538a2914fc2b757f262c7e38926, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:15.416057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:15.449649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1147/2301] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:15 2022] PUT /identity/v3/projects/9aef5cabce364fc9bd9c8ee1cbab8867/users/ad98d538a2914fc2b757f262c7e38926/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:15.451221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:15.470284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da330-df07-42ed-bf14-26e6559afbef admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:15.499658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:15.628884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2d0d-2db2-495d-b353-dfbd682683f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:15.630934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2d0d-2db2-495d-b353-dfbd682683f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:15.632292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2d0d-2db2-495d-b353-dfbd682683f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:15.633543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2d0d-2db2-495d-b353-dfbd682683f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:15.634822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b2d0d-2db2-495d-b353-dfbd682683f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:15.637914 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b2d0d-2db2-495d-b353-dfbd682683f1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:15.660159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1155/2302] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:15.664361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:15.678469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219910-f2a4-43be-859a-6a1b763d9d65 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:15.691467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:15.692377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:15.692769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:15.693079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] PATH_INFO: `/v3/projects/9aef5cabce364fc9bd9c8ee1cbab8867/users/ad98d538a2914fc2b757f262c7e38926/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:15.696170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aef5cabce364fc9bd9c8ee1cbab8867, user_id=ad98d538a2914fc2b757f262c7e38926, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:15.707015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:15.731999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1148/2303] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:15 2022] PUT /identity/v3/projects/9aef5cabce364fc9bd9c8ee1cbab8867/users/ad98d538a2914fc2b757f262c7e38926/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:15.742952 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:15.744395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:15.744686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:15.865184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] MFA Rules not processed for user `ad98d538a2914fc2b757f262c7e38926`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:15.867669 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:16.078517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1156/2304] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:16.092889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:16.095227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:16.183356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8d79-c4bb-4c6e-a764-8216f61875cb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:16.187069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21af61-b5f9-4e12-bed7-e3550c6c61d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:16.187671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21af61-b5f9-4e12-bed7-e3550c6c61d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:16.187971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21af61-b5f9-4e12-bed7-e3550c6c61d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:16.188284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21af61-b5f9-4e12-bed7-e3550c6c61d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:16.198695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21af61-b5f9-4e12-bed7-e3550c6c61d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:16.200188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21af61-b5f9-4e12-bed7-e3550c6c61d3 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:16.212067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1149/2305] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:16.307020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:16.316846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be7abb-9b7a-4c96-8e21-0e1fe6bd4c54 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:16.320641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba03c-ab9c-4523-b5cf-02d887bece68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:16.321339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba03c-ab9c-4523-b5cf-02d887bece68 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:16.321678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba03c-ab9c-4523-b5cf-02d887bece68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:16.322017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba03c-ab9c-4523-b5cf-02d887bece68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:16.340341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:16.340630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:16.340905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:16.361727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] MFA Rules not processed for user `29ddb65786ac485a96201211e1e2d39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:16.362985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:16.394527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba03c-ab9c-4523-b5cf-02d887bece68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:16.396504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba03c-ab9c-4523-b5cf-02d887bece68 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:16.412157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1157/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:16.430359 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1150/2307] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:22:21.558888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:21.559443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:21.559443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:21.565440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:21.597920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:21.599743 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:21.609900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:21.644950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:21.683661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3fe86-dff4-4ab0-9561-d53bd7cca90a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:21.688941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:21.689875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:21.690371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:21.690841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] PATH_INFO: `/v3/users/9fd97f61e90341dcba95aa08d80cd294` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:21.692487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd97f61e90341dcba95aa08d80cd294)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:21.694540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:21.703238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1158/2308] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:21.715723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:21.718479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:21.804503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd97f61e90341dcba95aa08d80cd294'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:21.827978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd97f61e90341dcba95aa08d80cd294'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:21.828796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd97f61e90341dcba95aa08d80cd294'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:21.836217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a02c-d33b-4ac2-9acf-4406d41bff7d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:21.850385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd97f61e90341dcba95aa08d80cd294'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:21.850850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad7eb-682e-49ef-b8a1-01a51c52d79d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:21.851785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad7eb-682e-49ef-b8a1-01a51c52d79d service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:21.852280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad7eb-682e-49ef-b8a1-01a51c52d79d service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:21.852624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad7eb-682e-49ef-b8a1-01a51c52d79d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:21.863241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd97f61e90341dcba95aa08d80cd294'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:21.863630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad7eb-682e-49ef-b8a1-01a51c52d79d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:21.865724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad7eb-682e-49ef-b8a1-01a51c52d79d service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:21.877012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1159/2309] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:22:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:22:21.879091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1151/2310] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:21 2022] DELETE /identity/v3/users/9fd97f61e90341dcba95aa08d80cd294 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:21.885331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:21.885331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:21.885331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:21.917237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:21.919312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:22.061492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1160/2311] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:22:22.099993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:22.104155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:22.272129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d61fe-7b09-47b5-a4a1-3c4c790ba959 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:22.280618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:22.281642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:22.282195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:22.282670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:22.310641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:22.312548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:22.342892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1152/2312] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:23.216130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:23.218357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:23.269819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97593-11f3-4044-9957-ad01a648e108 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:23.319616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:23.321145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:23.324666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:23.325130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] PATH_INFO: `/v3/projects/7d0d6c20d5284f2ba451aedc7ade9a46` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:23.328013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0d6c20d5284f2ba451aedc7ade9a46)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:23.331705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:23.473283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0d6c20d5284f2ba451aedc7ade9a46', 'request_id': 'req-30cf6746-6f05-4de0-8e44-61fdb27058ef'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.484319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0d6c20d5284f2ba451aedc7ade9a46', 'request_id': 'req-30cf6746-6f05-4de0-8e44-61fdb27058ef'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.511146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:23.518746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0d6c20d5284f2ba451aedc7ade9a46', 'request_id': 'req-30cf6746-6f05-4de0-8e44-61fdb27058ef'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.536436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] The token cache is being invalidate because project 7d0d6c20d5284f2ba451aedc7ade9a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:23.537144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.538315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.541008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1161/2313] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:23 2022] DELETE /identity/v3/projects/7d0d6c20d5284f2ba451aedc7ade9a46 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:23.544930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:23.577488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34cf68-8738-4553-9e16-49dec974dd3d service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:23.710933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:23.754330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:23.755230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:23.755615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:23.756451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] PATH_INFO: `/v3/users/ad98d538a2914fc2b757f262c7e38926` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:23.758849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad98d538a2914fc2b757f262c7e38926)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:23.761838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:23.877357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad98d538a2914fc2b757f262c7e38926'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.900942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad98d538a2914fc2b757f262c7e38926'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.906132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad98d538a2914fc2b757f262c7e38926'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.953305 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad98d538a2914fc2b757f262c7e38926'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.968366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0f1bbe98-6122-4ea8-a114-5ce36c392d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad98d538a2914fc2b757f262c7e38926'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:23.980170 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1153/2314] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:23 2022] DELETE /identity/v3/users/ad98d538a2914fc2b757f262c7e38926 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:25.058740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.060795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:25.076745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf6746-6f05-4de0-8e44-61fdb27058ef admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.166460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.167546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.168336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.168857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] PATH_INFO: `/v3/projects/9aef5cabce364fc9bd9c8ee1cbab8867` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.170688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aef5cabce364fc9bd9c8ee1cbab8867)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.174169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.227703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aef5cabce364fc9bd9c8ee1cbab8867', 'request_id': 'req-908c5146-e05b-4e03-8845-cd79f2ca09dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:25.233292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aef5cabce364fc9bd9c8ee1cbab8867', 'request_id': 'req-908c5146-e05b-4e03-8845-cd79f2ca09dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:25.241001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aef5cabce364fc9bd9c8ee1cbab8867', 'request_id': 'req-908c5146-e05b-4e03-8845-cd79f2ca09dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:25.252589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] The token cache is being invalidate because project 9aef5cabce364fc9bd9c8ee1cbab8867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:25.252871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:25.253483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-908c5146-e05b-4e03-8845-cd79f2ca09dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:25.254963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1162/2315] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:25 2022] DELETE /identity/v3/projects/9aef5cabce364fc9bd9c8ee1cbab8867 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:25.260155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.260673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.260775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.280694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:25.281845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:25.413536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1154/2316] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:25.420902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21304638-f228-43f7-933a-04495cd0d207 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.421191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21304638-f228-43f7-933a-04495cd0d207 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.421467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21304638-f228-43f7-933a-04495cd0d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.444137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-21304638-f228-43f7-933a-04495cd0d207 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:25.445651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-21304638-f228-43f7-933a-04495cd0d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:25.454425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1163/2317] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:25.459099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.470964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872db6-e3c2-449c-8176-407cbeb83e56 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.475940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.476588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.476876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.477162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.478309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:22:25.478309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.479715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.515081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1155/2318] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:22:25.520234 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21304638-f228-43f7-933a-04495cd0d207 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.534072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21304638-f228-43f7-933a-04495cd0d207 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.546441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.547279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.548312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.548694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.549678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.551934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.585731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1164/2319] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:25 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:25.590023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.601419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae850b-d7f7-420a-b9ae-96cdabb023ff admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.692785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.693421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.693706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.693982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.694652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.696725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.705352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:25.731339 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1156/2320] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:25 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:22:25.731593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.751970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddbf29-b5ce-45df-9274-84d3881d5535 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.759907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.760856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.761362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.761805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.762930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.764970 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.792363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1165/2321] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:22:25.796316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.808549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7512ef-6c64-4767-8727-e04857ca42ca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.833481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92145-a921-4e32-93fc-873a3358270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.834267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92145-a921-4e32-93fc-873a3358270d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.834654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92145-a921-4e32-93fc-873a3358270d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.835033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92145-a921-4e32-93fc-873a3358270d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.835980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92145-a921-4e32-93fc-873a3358270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.837835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92145-a921-4e32-93fc-873a3358270d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.862430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1157/2322] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:25.863057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:25.874984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad0384-ac96-4f7f-8423-3ed5363ca3b7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:25.892727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:25.893752 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.894195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.894631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] PATH_INFO: `/v3/projects/629b320d18414a259897bbc8410961e6/users/51201e0d81784c50878c46897674dcaf/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.916574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b320d18414a259897bbc8410961e6, user_id=51201e0d81784c50878c46897674dcaf, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:25.922503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:25.941263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1166/2323] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:25 2022] PUT /identity/v3/projects/629b320d18414a259897bbc8410961e6/users/51201e0d81784c50878c46897674dcaf/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:25.946606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dba34-bc0c-43f1-8dc9-a21e0438a7db None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:25.946922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dba34-bc0c-43f1-8dc9-a21e0438a7db None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:25.947193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dba34-bc0c-43f1-8dc9-a21e0438a7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:25.972857 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e97dba34-bc0c-43f1-8dc9-a21e0438a7db None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:25.975541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e97dba34-bc0c-43f1-8dc9-a21e0438a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:26.114540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1158/2324] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:22:26.122603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:26.128324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:26.154245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:26.223114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1e50-ac5a-4b32-b1c0-a6d1d6918c1b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:26.230927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:26.231569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:26.232062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:26.232343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:26.243701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:26.245240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:26.256119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1167/2325] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:33.674965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:33.675504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:33.675504 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:33.714007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] MFA Rules not processed for user `51201e0d81784c50878c46897674dcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:33.719521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:33.809423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1159/2326] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:33.815600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:33.826198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947299a-a0d5-47de-b955-ecdd53ff7205 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:33.832682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:33.833444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:33.834004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:33.834327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:33.836690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:33.838738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:33.873700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1168/2327] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:33 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:33.874594 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:33.886231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d42b68-5820-41b9-8a27-19ce041bff1e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:33.975993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:33.976632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:33.977018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:33.977294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:33.978202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:33.979935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:34.004933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:34.014163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1160/2328] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:33 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:22:34.018517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:34.031545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907893-5994-4579-9e08-1d760756bf9c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:34.040556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:34.041399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:34.042036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:34.042403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:34.043377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:34.045602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:34.090097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1169/2329] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:34.091294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:34.106085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a8b1-0720-4cac-968c-855a9c41780b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:34.119659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:34.120383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:34.120672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:34.120956 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] PATH_INFO: `/v3/projects/eca08163468d438e9887456443260e84/users/9fb91daa8faf417bab024d18859d8405/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:34.180260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca08163468d438e9887456443260e84, user_id=9fb91daa8faf417bab024d18859d8405, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:34.184790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:34.230681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1161/2330] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:34 2022] PUT /identity/v3/projects/eca08163468d438e9887456443260e84/users/9fb91daa8faf417bab024d18859d8405/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:22:34.232491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:34.274963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165342-8448-4521-93c6-e1c1e7fcf28a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:34.509668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0bddc-edc5-4e43-b5db-08eb9750256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:34.510589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0bddc-edc5-4e43-b5db-08eb9750256d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:34.510879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0bddc-edc5-4e43-b5db-08eb9750256d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:34.511202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0bddc-edc5-4e43-b5db-08eb9750256d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:34.511927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0bddc-edc5-4e43-b5db-08eb9750256d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:34.516347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0bddc-edc5-4e43-b5db-08eb9750256d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:34.539742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1170/2331] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:34.544075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:34.556685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfeb89-2ae2-4f04-8711-a20c4408707b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:34.572485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:34.573954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:34.574768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:34.575247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] PATH_INFO: `/v3/projects/eca08163468d438e9887456443260e84/users/9fb91daa8faf417bab024d18859d8405/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:34.579787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca08163468d438e9887456443260e84, user_id=9fb91daa8faf417bab024d18859d8405, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:34.584216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:34.607451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1162/2332] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:34 2022] PUT /identity/v3/projects/eca08163468d438e9887456443260e84/users/9fb91daa8faf417bab024d18859d8405/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:35.871319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5be9-d335-4f28-bb11-9a6fcd007683 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:35.872219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5be9-d335-4f28-bb11-9a6fcd007683 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:35.872712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5be9-d335-4f28-bb11-9a6fcd007683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:35.896189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-287d5be9-d335-4f28-bb11-9a6fcd007683 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:35.897661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-287d5be9-d335-4f28-bb11-9a6fcd007683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:35.975336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1171/2333] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:35.984964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:35.986889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:36.074096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7abc-d8c0-44df-8948-845adfd4d59e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:36.080876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:36.081809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:36.081952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:36.082224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:36.091385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:36.106164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:36.128836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1163/2334] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:22:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 14:22:36.677667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:36.678345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:36.678803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:36.718119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:36.723572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:36.784692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1172/2335] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:22:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:36.809264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:36.878888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156e2b-e0ae-4ca1-a86f-1c196ac3a2d5 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:36.894615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8855-ea44-4ca8-b9b5-a8475bfa3724 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:36.895255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8855-ea44-4ca8-b9b5-a8475bfa3724 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:36.895632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8855-ea44-4ca8-b9b5-a8475bfa3724 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:36.895909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8855-ea44-4ca8-b9b5-a8475bfa3724 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:36.915362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d8855-ea44-4ca8-b9b5-a8475bfa3724 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:36.917208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d8855-ea44-4ca8-b9b5-a8475bfa3724 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:36.930096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1164/2336] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:22:41.114012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:41.115875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:41.353327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:41.509754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd566a-50a5-4baa-9397-196596835a12 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:41.524877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:41.525723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:41.526009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:41.526462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] PATH_INFO: `/v3/users/1a4bc17bcc944036a98b6c3e5a1cd262` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:41.534137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4bc17bcc944036a98b6c3e5a1cd262)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:41.536170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:41.678989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4bc17bcc944036a98b6c3e5a1cd262'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:41.680246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4bc17bcc944036a98b6c3e5a1cd262'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:41.680891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4bc17bcc944036a98b6c3e5a1cd262'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:41.750998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4bc17bcc944036a98b6c3e5a1cd262'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:41.775302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4bc17bcc944036a98b6c3e5a1cd262'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:41.833889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1173/2337] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:22:41 2022] DELETE /identity/v3/users/1a4bc17bcc944036a98b6c3e5a1cd262 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:22:41.838405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:41.839266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:41.839700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:41.884528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:41.888709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:42.059644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1165/2338] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:42.084829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:42.086856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:42.280896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dade4-6982-4698-a784-af0e4a0d8b1f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:42.297106 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27d2a-c033-42ba-8656-56e5a72fdfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:42.297742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27d2a-c033-42ba-8656-56e5a72fdfbf service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:42.297987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27d2a-c033-42ba-8656-56e5a72fdfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:42.298673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27d2a-c033-42ba-8656-56e5a72fdfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:42.334558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d27d2a-c033-42ba-8656-56e5a72fdfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:42.336093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d27d2a-c033-42ba-8656-56e5a72fdfbf service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:42.364180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1174/2339] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:44.288966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:44.291073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:44.316023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ba18d-34e6-4ef2-b1a5-24a9c5d491f6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:44.333898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:44.335038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:44.335485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:44.335916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] PATH_INFO: `/v3/projects/7dcc237f8885415685fe3f29c39e3dc1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:44.338037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dcc237f8885415685fe3f29c39e3dc1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:44.344649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:44.443899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:44.477408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dcc237f8885415685fe3f29c39e3dc1', 'request_id': 'req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:44.491626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dcc237f8885415685fe3f29c39e3dc1', 'request_id': 'req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:44.511430 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dcc237f8885415685fe3f29c39e3dc1', 'request_id': 'req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:44.537378 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] The token cache is being invalidate because project 7dcc237f8885415685fe3f29c39e3dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:22:44.537854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:44.538971 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4b6cda9a-1dfc-424c-a046-52c4b6844cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:22:44.548715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1166/2340] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:22:44 2022] DELETE /identity/v3/projects/7dcc237f8885415685fe3f29c39e3dc1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:44.550926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:44.552407 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:44.553346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:44.636713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:44.645617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:44.793926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:44.861633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1175/2341] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:44.870453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:44.870734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:44.871205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:44.913051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:44.916322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:44.936343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1167/2342] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:44.950446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:44.974382 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd02143-233f-45a9-a43b-5f5091cdb5ab None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:45.007308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:45.010677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:45.011078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:45.011457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:45.014595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:22:45.015161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:45.021136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:45.073988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:45.074211 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1176/2343] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:22:45.086354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e0b8-da7c-42e6-bf50-578dcaa1f410 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:45.116583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:45.117424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:45.117978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:45.118418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:45.119204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:45.121316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:45.218687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1168/2344] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:22:45 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:45.223677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:45.238412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d23fb-ee9e-4510-9805-91255bf51890 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:45.498979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:45.499625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:45.499915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:45.500532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:45.501198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:45.508325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:45.550111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:45.550704 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1177/2345] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:22:45 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:22:45.568276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d97b5-b68c-4b88-b7ad-5047c5ab855b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:45.590774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:45.591832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:45.601898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:45.603641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:45.606098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:45.617863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:45.719467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1169/2346] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:22:45.723731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:45.785544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd999-3365-4805-b7aa-3a91bfb255f2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:45.837104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d731ff-fb55-45c7-88d6-73021f1e2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:45.837755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d731ff-fb55-45c7-88d6-73021f1e2f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:45.838035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d731ff-fb55-45c7-88d6-73021f1e2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:45.845200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d731ff-fb55-45c7-88d6-73021f1e2f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:45.856934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d731ff-fb55-45c7-88d6-73021f1e2f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:45.862224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d731ff-fb55-45c7-88d6-73021f1e2f34 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:45.933066 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:45.945326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1178/2347] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:22:45.954986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea279d-f872-4574-acff-2f178818ce41 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:45.977616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:45.982958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:45.983262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:45.983578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] PATH_INFO: `/v3/projects/4ad75022af774a36bacffc54c4591376/users/315f20e5f0064beebf31ba55ef8c2566/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:46.060292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad75022af774a36bacffc54c4591376, user_id=315f20e5f0064beebf31ba55ef8c2566, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:46.074738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:46.152935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f42c3-9425-4ead-a606-082ebf5b4628 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:46.153223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f42c3-9425-4ead-a606-082ebf5b4628 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:46.153502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f42c3-9425-4ead-a606-082ebf5b4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:46.169910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1170/2348] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:22:45 2022] PUT /identity/v3/projects/4ad75022af774a36bacffc54c4591376/users/315f20e5f0064beebf31ba55ef8c2566/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:22:46.266909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e87f42c3-9425-4ead-a606-082ebf5b4628 None None] MFA Rules not processed for user `315f20e5f0064beebf31ba55ef8c2566`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:46.268210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e87f42c3-9425-4ead-a606-082ebf5b4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:46.537201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1179/2349] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:46.552013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:46.554256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:46.688935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:46.689291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:46.689540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:46.734418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a0535-7a9e-4908-b665-adc3d70f1145 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:46.738331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] MFA Rules not processed for user `9ce6fbb5e7264feb816242192bcbf900`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:46.744442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f540f-d5e8-45dc-b0cb-e6dfee882fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:46.744666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:46.744766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f540f-d5e8-45dc-b0cb-e6dfee882fea service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:46.744766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f540f-d5e8-45dc-b0cb-e6dfee882fea service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:46.744766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f540f-d5e8-45dc-b0cb-e6dfee882fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:46.788301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f540f-d5e8-45dc-b0cb-e6dfee882fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:46.789536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f540f-d5e8-45dc-b0cb-e6dfee882fea service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:46.809455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:46.813376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1171/2350] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:46.902569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1180/2351] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:48.809623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a55650-7e12-4ccc-8880-21f1b1e867e3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:48.810589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a55650-7e12-4ccc-8880-21f1b1e867e3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:48.811078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a55650-7e12-4ccc-8880-21f1b1e867e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:48.877508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-18a55650-7e12-4ccc-8880-21f1b1e867e3 None None] MFA Rules not processed for user `9fb91daa8faf417bab024d18859d8405`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:48.879299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18a55650-7e12-4ccc-8880-21f1b1e867e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:49.008653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:49.135567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1172/2352] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:49.135829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:49.140728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:49.376083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaa31-348d-49d5-811f-d2c1e9adc358 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:49.397603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:49.398516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:49.398810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:49.399080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:49.404900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:49.627635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:22:49.629480 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:22:49.673235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1181/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:22:52.922847 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:52.923429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:52.923429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:52.992757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] MFA Rules not processed for user `51201e0d81784c50878c46897674dcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:22:52.997216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:53.022294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1173/2354] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:22:59.645870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=63 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:59.713171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:22:59.715009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:22:59.864966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3233-fd24-46f5-a181-f0f8369c13dd service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:22:59.869242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:22:59.871064 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:22:59.871425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:22:59.871811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:22:59.875057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:00.124456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:00.126141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e9784-e90c-4565-86a9-dcbd15dd44b8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:00.143455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1182/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:02.484717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:02.577086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf54ae-154b-4b74-8583-8798e6515d1a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:02.582401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:02.583286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:02.583740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:02.584204 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] PATH_INFO: `/v3/users/315f20e5f0064beebf31ba55ef8c2566` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:02.585520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315f20e5f0064beebf31ba55ef8c2566)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:02.587802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:02.708426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315f20e5f0064beebf31ba55ef8c2566'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:02.725729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315f20e5f0064beebf31ba55ef8c2566'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:02.726686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315f20e5f0064beebf31ba55ef8c2566'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:02.764930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315f20e5f0064beebf31ba55ef8c2566'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:02.783595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315f20e5f0064beebf31ba55ef8c2566'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:02.797746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1174/2356] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:23:02 2022] DELETE /identity/v3/users/315f20e5f0064beebf31ba55ef8c2566 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:23:02.814838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:02.815628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:02.815628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:02.871935 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:02.875376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:03.030483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1183/2357] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:03.037457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:03.040208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:03.164674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a85a2c-898d-4471-9dd6-347c6da76093 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:03.171989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1be67-acb8-4af3-8ff4-32f53731d7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:03.172723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1be67-acb8-4af3-8ff4-32f53731d7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:03.172959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1be67-acb8-4af3-8ff4-32f53731d7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:03.173233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1be67-acb8-4af3-8ff4-32f53731d7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:03.198912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1be67-acb8-4af3-8ff4-32f53731d7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:03.200567 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1be67-acb8-4af3-8ff4-32f53731d7c6 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:03.207015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:03.217621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1175/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:03.890055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:03.891639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:03.913150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c89b5-bd4e-4167-870b-e2a01707723c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:03.927933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:03.928638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:03.928924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:03.929198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] PATH_INFO: `/v3/projects/4ad75022af774a36bacffc54c4591376` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:03.931247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad75022af774a36bacffc54c4591376)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:03.933492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:04.011003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:04.012636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad75022af774a36bacffc54c4591376', 'request_id': 'req-28396cac-9348-41e3-9ca2-271dd6cd6fab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:04.021560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad75022af774a36bacffc54c4591376', 'request_id': 'req-28396cac-9348-41e3-9ca2-271dd6cd6fab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:04.033934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad75022af774a36bacffc54c4591376', 'request_id': 'req-28396cac-9348-41e3-9ca2-271dd6cd6fab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:04.061439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] The token cache is being invalidate because project 4ad75022af774a36bacffc54c4591376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:23:04.061780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:04.062540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-28396cac-9348-41e3-9ca2-271dd6cd6fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:04.076348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1184/2359] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:23:03 2022] DELETE /identity/v3/projects/4ad75022af774a36bacffc54c4591376 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:23:05.892335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1670-c3b3-4f46-962c-55cc7243bb26 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:05.893118 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1670-c3b3-4f46-962c-55cc7243bb26 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:05.893118 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1670-c3b3-4f46-962c-55cc7243bb26 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:05.894678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1176/2360] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:23:05.906582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf000-de0f-4ac0-b238-5bdc7e7d8140 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:05.907426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf000-de0f-4ac0-b238-5bdc7e7d8140 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:05.907426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf000-de0f-4ac0-b238-5bdc7e7d8140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:05.954761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f04bf000-de0f-4ac0-b238-5bdc7e7d8140 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:05.956257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f04bf000-de0f-4ac0-b238-5bdc7e7d8140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:06.045985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1185/2361] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:07.908425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1670-c3b3-4f46-962c-55cc7243bb26 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:07.910257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ae0c1670-c3b3-4f46-962c-55cc7243bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:07.992178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1670-c3b3-4f46-962c-55cc7243bb26 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:07.995947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c225d-65ca-4211-abb7-8255adb03571 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:07.996727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c225d-65ca-4211-abb7-8255adb03571 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:07.997009 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c225d-65ca-4211-abb7-8255adb03571 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:07.997280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c225d-65ca-4211-abb7-8255adb03571 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.007885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c225d-65ca-4211-abb7-8255adb03571 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:08.009370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c225d-65ca-4211-abb7-8255adb03571 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:08.021241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1177/2362] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:08.112588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d647e-d6af-4046-9a2b-b4c73edaa23d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:08.113112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d647e-d6af-4046-9a2b-b4c73edaa23d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:08.113322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d647e-d6af-4046-9a2b-b4c73edaa23d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.114511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1186/2363] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:23:08.123010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7e9b6-9174-4f6d-9105-9b9dcebceaae None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:08.123363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7e9b6-9174-4f6d-9105-9b9dcebceaae None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:08.123734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7e9b6-9174-4f6d-9105-9b9dcebceaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.143545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-07f7e9b6-9174-4f6d-9105-9b9dcebceaae None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:08.144771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-07f7e9b6-9174-4f6d-9105-9b9dcebceaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:08.196077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1178/2364] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:08.208592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d647e-d6af-4046-9a2b-b4c73edaa23d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:08.210376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e15d647e-d6af-4046-9a2b-b4c73edaa23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:08.223648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d647e-d6af-4046-9a2b-b4c73edaa23d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:08.227775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb422697-5ee2-4657-942d-36320da9e1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:08.228422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb422697-5ee2-4657-942d-36320da9e1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:08.228705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb422697-5ee2-4657-942d-36320da9e1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:08.228986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb422697-5ee2-4657-942d-36320da9e1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.236528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb422697-5ee2-4657-942d-36320da9e1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:08.238120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb422697-5ee2-4657-942d-36320da9e1f3 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:08.246402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1187/2365] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:08.336534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a42e-7ea5-4558-98bf-cc635b875595 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:08.336843 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a42e-7ea5-4558-98bf-cc635b875595 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:08.337319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a42e-7ea5-4558-98bf-cc635b875595 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.339078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1179/2366] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:23:08.345428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8452-5e28-42b8-a67c-5adf57d0aced None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:08.345716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8452-5e28-42b8-a67c-5adf57d0aced None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:08.345998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8452-5e28-42b8-a67c-5adf57d0aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.365706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-452f8452-5e28-42b8-a67c-5adf57d0aced None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:08.366905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-452f8452-5e28-42b8-a67c-5adf57d0aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:08.376561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1188/2367] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:08.386904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a42e-7ea5-4558-98bf-cc635b875595 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:08.398518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a42e-7ea5-4558-98bf-cc635b875595 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:08.402092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236922db-659d-4874-9049-338773db122f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:08.402679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236922db-659d-4874-9049-338773db122f service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:08.402953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236922db-659d-4874-9049-338773db122f service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:08.403220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236922db-659d-4874-9049-338773db122f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:08.412994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236922db-659d-4874-9049-338773db122f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:08.414416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236922db-659d-4874-9049-338773db122f service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:08.425053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1180/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:09.051456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6735d68-8e70-458a-864e-aa60306170e4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:09.051744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6735d68-8e70-458a-864e-aa60306170e4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:09.052062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6735d68-8e70-458a-864e-aa60306170e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:09.070432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b6735d68-8e70-458a-864e-aa60306170e4 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:09.071626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b6735d68-8e70-458a-864e-aa60306170e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:09.124658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1189/2369] 10.222.0.23 () {58 vars in 967 bytes} [Wed Aug 17 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:09.136554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236922db-659d-4874-9049-338773db122f service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:09.137938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-236922db-659d-4874-9049-338773db122f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:09.212340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236922db-659d-4874-9049-338773db122f service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:09.217922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0068-6589-48b2-875e-c92d4327af34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:09.218560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0068-6589-48b2-875e-c92d4327af34 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:09.218835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0068-6589-48b2-875e-c92d4327af34 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:09.219105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0068-6589-48b2-875e-c92d4327af34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:09.227096 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0068-6589-48b2-875e-c92d4327af34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:09.228865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0068-6589-48b2-875e-c92d4327af34 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:09.237503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1181/2370] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:23:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:23:11.523085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cccf8-cf3a-4301-9974-671992cebe17 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:11.523600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cccf8-cf3a-4301-9974-671992cebe17 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:11.523713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cccf8-cf3a-4301-9974-671992cebe17 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:11.525272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1190/2371] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 14:23:11.573637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:11.574124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:11.574941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:11.597437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] MFA Rules not processed for user `70af8d78a61a4155a37c330b19123a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:11.598703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:11.626201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:11.693857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cccf8-cf3a-4301-9974-671992cebe17 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:11.696656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-611cccf8-cf3a-4301-9974-671992cebe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:11.704585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1182/2372] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:11.731398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:11.733713 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:11.751773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a158-b14c-4653-b437-c4d646376227 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:11.760591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:11.761377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:11.761761 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:11.762138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:11.780909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:11.783120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:11.787666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:11.799362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1183/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:23:11.819413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cccf8-cf3a-4301-9974-671992cebe17 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:11.828433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:11.829117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:11.829397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:11.829672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] PATH_INFO: `/v3/users/bd1bab7e87ff435da29d6abf2fd9d473` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:11.830855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1bab7e87ff435da29d6abf2fd9d473)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:11.833076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:11.887829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1bab7e87ff435da29d6abf2fd9d473'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:11.888604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1bab7e87ff435da29d6abf2fd9d473'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:11.889258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1bab7e87ff435da29d6abf2fd9d473'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:11.907930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1bab7e87ff435da29d6abf2fd9d473'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:11.919790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cb3f9d31-cf98-4223-a468-6bdfd3918eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1bab7e87ff435da29d6abf2fd9d473'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:11.936685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1191/2374] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:23:11 2022] DELETE /identity/v3/users/bd1bab7e87ff435da29d6abf2fd9d473 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:23:12.117194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.130721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b531f-85d9-4b9e-a591-236520ca3738 service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.174198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.174396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.174664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.195990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:12.197242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:12.220948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.221604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.221958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.222303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] PATH_INFO: `/v3/projects/96abbc1c79a7419abca516c7556a535f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.223558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96abbc1c79a7419abca516c7556a535f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.225589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.263869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1192/2375] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:23:12.276478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.279138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:12.285053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96abbc1c79a7419abca516c7556a535f', 'request_id': 'req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:12.292770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96abbc1c79a7419abca516c7556a535f', 'request_id': 'req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:12.301514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96abbc1c79a7419abca516c7556a535f', 'request_id': 'req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:12.313454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] The token cache is being invalidate because project 96abbc1c79a7419abca516c7556a535f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:23:12.313778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:12.314423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c00c9e9-d569-4e24-ad4d-b53dc3b19469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:23:12.315913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1184/2376] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:23:12 2022] DELETE /identity/v3/projects/96abbc1c79a7419abca516c7556a535f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:23:12.320871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940fccf-473b-459a-b014-47923421310c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.321236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940fccf-473b-459a-b014-47923421310c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.321638 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940fccf-473b-459a-b014-47923421310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.342948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d940fccf-473b-459a-b014-47923421310c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:12.344294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d940fccf-473b-459a-b014-47923421310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:12.363266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7579-e155-47b7-a78f-7b87694a5308 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.378934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:12.389482 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:12.412877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1185/2377] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:23:12.422180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.422469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.422748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.433045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.433681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.433966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.434238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.436613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:12.442166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:12.443331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:12.451283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1186/2378] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:23:12.455250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.464109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4932f-9606-4a82-8adb-f0064e007917 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.468983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.469621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.469900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.470202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.470868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:23:12.471224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.473024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.489244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1187/2379] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:23:12.493783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.501274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.503837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.505640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e541f9-357e-402c-955f-ed6e002cc8d5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.511200 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.511887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.512260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.512614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.513836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.513955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1193/2380] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:23:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 14:23:12.515906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.548418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1188/2381] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:23:12 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:23:12.549690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.562577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37ff2a-97e4-4bc8-a4e6-6c68b57ebeaa service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.644400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.645217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.645570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.646545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.646787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.649418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.690141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1194/2382] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:23:12 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:23:12.692308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.708235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899eade-fb2a-48c3-815a-f40949684dd3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.715653 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.717464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.718254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.718807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.719684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.721985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.749404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1189/2383] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:23:12.750410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.764051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33ea6-d782-4488-8d78-7e6b9c4da922 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.771018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17053e9-0094-4919-bde2-26c8bce7eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.771672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17053e9-0094-4919-bde2-26c8bce7eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.771949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17053e9-0094-4919-bde2-26c8bce7eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.772247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17053e9-0094-4919-bde2-26c8bce7eca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.772897 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17053e9-0094-4919-bde2-26c8bce7eca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.774821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17053e9-0094-4919-bde2-26c8bce7eca6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.787042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1195/2384] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:23:12.791425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:12.802437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fcb5-7428-4961-a6e5-79bb91a89a2e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:12.807367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:12.808186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.808481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.808953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] PATH_INFO: `/v3/projects/12f7f3899f544a8f8ef70dea6943134b/users/177dac1c00bc408294c208225b02cfaa/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.843112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f7f3899f544a8f8ef70dea6943134b, user_id=177dac1c00bc408294c208225b02cfaa, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:12.846583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:12.870053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1190/2385] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:23:12 2022] PUT /identity/v3/projects/12f7f3899f544a8f8ef70dea6943134b/users/177dac1c00bc408294c208225b02cfaa/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:23:12.875778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24b9be-520d-4388-afab-daf0282a994c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:12.876275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24b9be-520d-4388-afab-daf0282a994c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:12.876679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24b9be-520d-4388-afab-daf0282a994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:12.905318 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aa24b9be-520d-4388-afab-daf0282a994c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:12.906944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aa24b9be-520d-4388-afab-daf0282a994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:12.968039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:13.006977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1196/2386] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:13.021552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:13.037853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:13.127246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f37b-dbd2-48e1-90f9-61978d3a019e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:13.131255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:13.131874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:13.132212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:13.132916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:13.142915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:13.145405 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:13.170065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1191/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:14.108141 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658be8-4b86-4f4e-b48d-0abcca950c6c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:14.108665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658be8-4b86-4f4e-b48d-0abcca950c6c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:14.108772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658be8-4b86-4f4e-b48d-0abcca950c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:14.155087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b7658be8-4b86-4f4e-b48d-0abcca950c6c None None] MFA Rules not processed for user `177dac1c00bc408294c208225b02cfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:14.156560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7658be8-4b86-4f4e-b48d-0abcca950c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:14.260422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1197/2388] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:14.275128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:14.277325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:14.382759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b843de8-476b-420e-afad-fdf9972a8edb service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:14.390049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:14.390049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:14.390049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:14.390049 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:14.399371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:14.400898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:14.425070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1192/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:15.864558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458b84-e056-4a1b-94ea-6f2b9ac88cf7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:15.865233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458b84-e056-4a1b-94ea-6f2b9ac88cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:15.865233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de458b84-e056-4a1b-94ea-6f2b9ac88cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:15.886732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-de458b84-e056-4a1b-94ea-6f2b9ac88cf7 None None] MFA Rules not processed for user `177dac1c00bc408294c208225b02cfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:15.888583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-de458b84-e056-4a1b-94ea-6f2b9ac88cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:15.895475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1198/2390] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:24.414429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:25.881663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=45 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:29.618188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:29.621064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:29.739290 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ddbb-1574-4b15-9a4a-17b542eb8670 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:29.745245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:29.749770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:29.750240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:29.750683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:29.753376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:29.767329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:29.769257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:29.785674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1193/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:32.789397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:32.789838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:32.789960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:32.810705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:32.812076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:32.870122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1199/2392] 10.222.0.23 () {58 vars in 967 bytes} [Wed Aug 17 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:32.883289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:32.884789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:32.956775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef475f-1280-48bf-a8ce-55f8236a2e8b service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:32.961854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984627cd-7c88-493f-a155-02fc919b659a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:32.962462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984627cd-7c88-493f-a155-02fc919b659a service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:32.962744 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984627cd-7c88-493f-a155-02fc919b659a service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:32.963019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984627cd-7c88-493f-a155-02fc919b659a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:32.971440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984627cd-7c88-493f-a155-02fc919b659a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:32.973077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984627cd-7c88-493f-a155-02fc919b659a service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:32.981523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1194/2393] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:23:41.076241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:23:41.091557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555cb35-947c-474a-81d6-9bcf924f44ca None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:23:41.096667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:23:41.097412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:41.097693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:41.097968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:41.101425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:41.202292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:23:41.204711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3515ac-af25-4463-b7c0-a4a01c63c661 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:23:41.222615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1200/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:23:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:23:42.977892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=64 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:50.599441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:23:50.600075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:23:50.600075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:23:50.618957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] MFA Rules not processed for user `b5872d0410214dd6b44c36c7952a5ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:23:50.620953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:23:50.677219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1195/2395] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:23:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:23:51.216645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=55 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:00.670269 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=25 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:02.054808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d647-7998-4e0d-b342-2dcad55efb30 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:02.055345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d647-7998-4e0d-b342-2dcad55efb30 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:02.055345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d647-7998-4e0d-b342-2dcad55efb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:02.074944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1b08d647-7998-4e0d-b342-2dcad55efb30 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:02.076173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1b08d647-7998-4e0d-b342-2dcad55efb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:02.083888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1201/2396] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:02.101490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:02.103006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:02.178752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086563-e7c7-4f2a-bb9e-ed3eef749779 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:02.184601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:02.185216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:02.185494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:02.185763 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:02.193738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:02.195317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:02.205304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1196/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:24:06.025959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7499e-9a1e-4096-810c-f4c337b9dd3b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:06.026460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7499e-9a1e-4096-810c-f4c337b9dd3b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:06.026460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7499e-9a1e-4096-810c-f4c337b9dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:06.046961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-72e7499e-9a1e-4096-810c-f4c337b9dd3b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:06.048230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-72e7499e-9a1e-4096-810c-f4c337b9dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:06.056176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1202/2398] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:06.070869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:06.082476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e61dde-7d17-4cbd-bd39-9900b8634b99 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:06.088542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:06.089179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:06.089460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:06.089733 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:06.098100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:06.099673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:06.109765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1197/2399] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:24:09.294932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efae1-16a8-4f5e-832e-e3880f570326 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:09.295490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efae1-16a8-4f5e-832e-e3880f570326 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:09.295490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efae1-16a8-4f5e-832e-e3880f570326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:09.314961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-501efae1-16a8-4f5e-832e-e3880f570326 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:09.316202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-501efae1-16a8-4f5e-832e-e3880f570326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:09.324654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1203/2400] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:09.341468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:09.342863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:09.357901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b046-2321-4f6e-8486-defa14eb3f0c service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:09.363421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:09.364069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:09.364352 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:09.364652 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:09.373842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:09.375407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:09.384610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1198/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:24:12.369111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd0691-f122-425e-a69d-3bc2e5c4ada2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:12.369584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd0691-f122-425e-a69d-3bc2e5c4ada2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:12.369694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd0691-f122-425e-a69d-3bc2e5c4ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:12.390071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c5fd0691-f122-425e-a69d-3bc2e5c4ada2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:12.391274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c5fd0691-f122-425e-a69d-3bc2e5c4ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:12.399201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1204/2402] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:12.415796 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:12.426813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb830eb-5aae-4d33-be7a-bf9f991a174b service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:12.432203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:12.432790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:12.433071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:12.433340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:12.441310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:12.442872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:12.453222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1199/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:24:15.517426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d78b-2d56-4ad2-83d7-de38f2db3b16 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:15.517886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d78b-2d56-4ad2-83d7-de38f2db3b16 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:15.517996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d78b-2d56-4ad2-83d7-de38f2db3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:15.537394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1776d78b-2d56-4ad2-83d7-de38f2db3b16 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:15.538584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1776d78b-2d56-4ad2-83d7-de38f2db3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:15.546681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1205/2404] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:15.564623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:15.575835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05357c-0092-4008-99b6-9bf4579f0308 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:15.581231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:15.581929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:15.582321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:15.582599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:15.591188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:15.592848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:15.602332 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1200/2405] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:24:18.672460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3686a2-ca4a-4d9e-9608-55f7c0eaf2f1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:18.672977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3686a2-ca4a-4d9e-9608-55f7c0eaf2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:18.673085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3686a2-ca4a-4d9e-9608-55f7c0eaf2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:18.692386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2b3686a2-ca4a-4d9e-9608-55f7c0eaf2f1 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:18.693585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2b3686a2-ca4a-4d9e-9608-55f7c0eaf2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:18.702246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1206/2406] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:18.718867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:18.730508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a0d0e-7146-47aa-bbdb-6a4728a77d20 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:18.736146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1db47-739e-42d1-b961-49d19895a6f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:18.736748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1db47-739e-42d1-b961-49d19895a6f9 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:18.737027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1db47-739e-42d1-b961-49d19895a6f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:18.737298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1db47-739e-42d1-b961-49d19895a6f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:18.746350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1db47-739e-42d1-b961-49d19895a6f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:18.747937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1db47-739e-42d1-b961-49d19895a6f9 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:18.757325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1201/2407] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:24:28.687695 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=18 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:28.753177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=64 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:36.564175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297f3e-01cf-420e-9f6e-63f11b04e741 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:36.564682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297f3e-01cf-420e-9f6e-63f11b04e741 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:36.564777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297f3e-01cf-420e-9f6e-63f11b04e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:36.583111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e6297f3e-01cf-420e-9f6e-63f11b04e741 None None] MFA Rules not processed for user `c444d49243af4f2994bdc510e59dbe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:36.584360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e6297f3e-01cf-420e-9f6e-63f11b04e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:36.638661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1207/2408] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:24:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:37.249829 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f79ec-1114-43b0-a005-16b5af9d7b0b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:37.250276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f79ec-1114-43b0-a005-16b5af9d7b0b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:37.250376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f79ec-1114-43b0-a005-16b5af9d7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:37.290132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-794f79ec-1114-43b0-a005-16b5af9d7b0b None None] MFA Rules not processed for user `177dac1c00bc408294c208225b02cfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:37.292883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-794f79ec-1114-43b0-a005-16b5af9d7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:37.304186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1202/2409] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:46.632259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=25 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:47.266645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:55.944331 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:55.944885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:55.944885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:55.963350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] MFA Rules not processed for user `9ce6fbb5e7264feb816242192bcbf900`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:55.964566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:56.017910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1208/2410] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:24:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:57.912812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2937-9917-40ab-a31c-b939c24f12d5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:57.913320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2937-9917-40ab-a31c-b939c24f12d5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:57.913418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2937-9917-40ab-a31c-b939c24f12d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:57.933714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-449d2937-9917-40ab-a31c-b939c24f12d5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:57.934926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-449d2937-9917-40ab-a31c-b939c24f12d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:57.942921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1203/2411] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:57.957328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:57.971736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506cd00-a0d1-47c6-9966-9faece3ba11b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:57.978232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:57.979132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:57.979415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:57.979687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:57.988209 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:57.989792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:57.999154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1209/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:24:58.170455 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88665-d9fa-4d64-bbf2-12d3e8f2e17d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:58.170953 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88665-d9fa-4d64-bbf2-12d3e8f2e17d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:58.171448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88665-d9fa-4d64-bbf2-12d3e8f2e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:58.190746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b5a88665-d9fa-4d64-bbf2-12d3e8f2e17d None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:24:58.192177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b5a88665-d9fa-4d64-bbf2-12d3e8f2e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:24:58.199751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1204/2413] 10.222.0.23 () {58 vars in 967 bytes} [Wed Aug 17 14:24:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:24:58.244907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:24:58.256144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeeffc-b449-4343-85ef-348b8dd71c3c service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:24:58.261653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:24:58.262245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:24:58.262522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:24:58.262794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:24:58.270569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:24:58.272172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:24:58.280662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1210/2414] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:25:02.363019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866b4e-7d50-4dd4-8791-ad6397d73834 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:02.363577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866b4e-7d50-4dd4-8791-ad6397d73834 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:02.363577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866b4e-7d50-4dd4-8791-ad6397d73834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:02.428172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d5866b4e-7d50-4dd4-8791-ad6397d73834 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:25:02.430757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5866b4e-7d50-4dd4-8791-ad6397d73834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:02.447920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1205/2415] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:25:02.471632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:02.491698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb4b8-552f-4a78-afb1-4ef95075ad01 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:02.500739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:02.501621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:02.502085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:02.502567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:02.517152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:02.520420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:02.541899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1211/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:05.435574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:05.436725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:05.437007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:05.458691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:25:05.459919 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:05.469865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1206/2417] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:25:05.487406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:05.514671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53fb9-fc0e-4ebd-b338-3037d4c6ca45 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:05.532660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:05.533292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:05.533839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:05.534279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:05.550941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:05.552851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:05.578741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1212/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:06.140038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:06.141555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:06.162156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b405bb6-2123-4a83-a37f-d6e0c55f6b5f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:06.173424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:06.174517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:06.174809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:06.175084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] PATH_INFO: `/v3/users/29ddb65786ac485a96201211e1e2d39d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:06.176340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ddb65786ac485a96201211e1e2d39d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:06.178364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:06.238099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ddb65786ac485a96201211e1e2d39d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.248227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ddb65786ac485a96201211e1e2d39d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.249058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ddb65786ac485a96201211e1e2d39d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.265968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ddb65786ac485a96201211e1e2d39d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.274581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ddb65786ac485a96201211e1e2d39d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.283574 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1207/2419] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:25:06 2022] DELETE /identity/v3/users/29ddb65786ac485a96201211e1e2d39d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:25:06.548999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:06.559755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9be5e-50e6-42ba-95aa-a66332d77863 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:06.626927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:06.627569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:06.627859 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:06.628171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] PATH_INFO: `/v3/projects/dcce6400d6c245819a5a67d2eff4920f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:06.629302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcce6400d6c245819a5a67d2eff4920f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:06.631237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:06.678293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcce6400d6c245819a5a67d2eff4920f', 'request_id': 'req-160c6a33-8267-4212-99c7-cd845b370f9e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.683124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:06.685404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcce6400d6c245819a5a67d2eff4920f', 'request_id': 'req-160c6a33-8267-4212-99c7-cd845b370f9e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.694487 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcce6400d6c245819a5a67d2eff4920f', 'request_id': 'req-160c6a33-8267-4212-99c7-cd845b370f9e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.709658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] The token cache is being invalidate because project dcce6400d6c245819a5a67d2eff4920f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:25:06.709658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.710401 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.711925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1213/2420] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:25:06 2022] DELETE /identity/v3/projects/dcce6400d6c245819a5a67d2eff4920f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:25:06.715858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:06.717619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:06.741057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba97e8-6f7a-4e0a-a332-fe9dbf926134 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:06.822864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:06.823501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:06.823781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:06.824086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] PATH_INFO: `/v3/users/5f4546adc4cf4a8ba115b5743d19443c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:06.825293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4546adc4cf4a8ba115b5743d19443c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:06.827292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:06.876161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4546adc4cf4a8ba115b5743d19443c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.877670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:06.887147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4546adc4cf4a8ba115b5743d19443c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.888001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4546adc4cf4a8ba115b5743d19443c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.903533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4546adc4cf4a8ba115b5743d19443c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.913736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03201c5d-63ab-43f6-947c-8bbde64ba878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4546adc4cf4a8ba115b5743d19443c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:06.921145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1208/2421] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:25:06 2022] DELETE /identity/v3/users/5f4546adc4cf4a8ba115b5743d19443c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:25:07.114068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:07.115624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:07.134451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c6a33-8267-4212-99c7-cd845b370f9e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:07.212541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:07.213188 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:07.213630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:07.214068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] PATH_INFO: `/v3/projects/beb1e2f2895247b0b9178c2409a2297d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:07.216339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb1e2f2895247b0b9178c2409a2297d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:07.218300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:07.298554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb1e2f2895247b0b9178c2409a2297d', 'request_id': 'req-5e52631b-3a1c-4afc-8f70-2c1de720f02c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:07.307463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb1e2f2895247b0b9178c2409a2297d', 'request_id': 'req-5e52631b-3a1c-4afc-8f70-2c1de720f02c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:07.319429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb1e2f2895247b0b9178c2409a2297d', 'request_id': 'req-5e52631b-3a1c-4afc-8f70-2c1de720f02c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:07.333599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] The token cache is being invalidate because project beb1e2f2895247b0b9178c2409a2297d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:25:07.333891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:07.334642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:07.336359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1214/2422] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:25:07 2022] DELETE /identity/v3/projects/beb1e2f2895247b0b9178c2409a2297d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:25:08.606065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4796-57c4-491c-a28f-dabccd02b814 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:08.606502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4796-57c4-491c-a28f-dabccd02b814 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:08.606771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4796-57c4-491c-a28f-dabccd02b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:08.627658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-27cb4796-57c4-491c-a28f-dabccd02b814 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:25:08.629110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-27cb4796-57c4-491c-a28f-dabccd02b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:08.691739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1209/2423] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:25:08.708188 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:08.709667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:08.790657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52631b-3a1c-4afc-8f70-2c1de720f02c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:08.797069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db931a-44db-48e0-91b1-869f3c4bdb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:08.797764 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db931a-44db-48e0-91b1-869f3c4bdb7c service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:08.798119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db931a-44db-48e0-91b1-869f3c4bdb7c service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:08.798469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db931a-44db-48e0-91b1-869f3c4bdb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:08.807409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db931a-44db-48e0-91b1-869f3c4bdb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:08.809271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db931a-44db-48e0-91b1-869f3c4bdb7c service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:08.813441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:08.821335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1215/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:09.905060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:09.905557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:09.905654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:09.925514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] MFA Rules not processed for user `b5872d0410214dd6b44c36c7952a5ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:25:09.926860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:09.983582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1210/2425] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:25:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:25:11.785323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:11.785845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:11.785926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:11.806172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:25:11.807395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:11.815711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1216/2426] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 14:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:25:11.838008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:11.850639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85fa5-77a8-46ac-a103-358bddd0fa85 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:11.856373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:11.856999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:11.857293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:11.857560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:11.866418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:11.868531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:11.878483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1211/2427] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:21.801481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:21.873783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=70,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:22.321309 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:22.322697 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:22.378336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c2aa-faa3-4eb7-af16-03f3fd3ada0b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:22.382117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:22.382727 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:22.383003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:22.383314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:22.386703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:22.401634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:22.403217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:22.415045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1217/2428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:23.974937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:23.976379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:23.988661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7975236-bd54-404d-82ad-346868d7442a service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:23.992228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:23.993312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:23.993589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:23.993859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:23.995503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:24.008893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:24.010343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:24.021018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1212/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:32.409549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=26 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:34.016189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:40.787146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:40.788865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:40.851491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:40.854236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:40.861843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ddc93-2c70-42ea-82e7-420dae9f0b00 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:40.867097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:40.867734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:40.868075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:40.868575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:40.870317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:40.873906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126ad11-5715-417c-add3-58e31cb37090 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:40.878288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:40.878905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:40.879187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:40.879456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] PATH_INFO: `/v3/users/177dac1c00bc408294c208225b02cfaa` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:40.880591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177dac1c00bc408294c208225b02cfaa)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:40.882497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:40.882629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:40.884207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:40.894258 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1218/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:40.936017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177dac1c00bc408294c208225b02cfaa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:40.943023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177dac1c00bc408294c208225b02cfaa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:40.943695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177dac1c00bc408294c208225b02cfaa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:40.955681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177dac1c00bc408294c208225b02cfaa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:40.964362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177dac1c00bc408294c208225b02cfaa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:40.970081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1213/2431] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:25:40 2022] DELETE /identity/v3/users/177dac1c00bc408294c208225b02cfaa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:25:41.147986 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:41.159149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a605956-dcdc-4159-9135-157ecb47f2dd service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:41.225164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:41.225806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:41.226120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:41.226412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] PATH_INFO: `/v3/projects/12f7f3899f544a8f8ef70dea6943134b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:41.227546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f7f3899f544a8f8ef70dea6943134b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:41.229561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:41.276823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f7f3899f544a8f8ef70dea6943134b', 'request_id': 'req-16a832ad-007c-472e-9edf-1a7933763234'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:41.282831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f7f3899f544a8f8ef70dea6943134b', 'request_id': 'req-16a832ad-007c-472e-9edf-1a7933763234'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:41.291427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f7f3899f544a8f8ef70dea6943134b', 'request_id': 'req-16a832ad-007c-472e-9edf-1a7933763234'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:41.303316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] The token cache is being invalidate because project 12f7f3899f544a8f8ef70dea6943134b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:25:41.303841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:41.304532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:25:41.306087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1219/2432] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:25:41 2022] DELETE /identity/v3/projects/12f7f3899f544a8f8ef70dea6943134b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:25:43.621392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:43.622794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:43.694282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd93ef-00ed-45e2-b25a-1d0ce1cb5921 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:43.754899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:43.755511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:43.755788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:43.756086 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:43.757817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:43.763639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:43.816759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:43.818391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568aea9-8c3f-43ef-a76e-51ec85932df2 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:43.828025 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1214/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:45.342415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:45.343798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:45.361374 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a832ad-007c-472e-9edf-1a7933763234 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:45.367548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:45.368191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:45.368472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:45.368740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:45.370469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:45.389797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:45.432497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:45.434093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:45.443069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1220/2434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:25:53.823398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=24 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:55.438902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=19 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:58.725661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:58.726143 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:58.726265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:58.749630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:25:58.750920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:58.812723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1215/2435] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:25:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:25:58.857626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:58.859042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:58.934616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093912-d15c-403a-9c94-0f2a819b9487 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:58.939637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:58.940285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:58.940570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:58.940845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:58.950219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:58.951855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:58.960578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1221/2436] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:25:59.434606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:25:59.436325 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:59.499497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020a92f-e8fb-45df-a367-fa81f469b13d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:25:59.503656 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:25:59.504313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:25:59.504591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:25:59.504867 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:25:59.507149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:25:59.584081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:25:59.585721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:25:59.598518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1216/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:01.128820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:01.160300 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631f6a-b24b-44b4-a6e0-ab0ecb4cfa9f service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:01.168759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:01.169501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:01.170172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:01.170172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:01.171898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:01.236667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:01.238456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:01.248690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1222/2438] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:03.809782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:03.811622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:03.827387 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0640cc-bd23-4b7f-9c7d-c65654982fb1 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:03.831519 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:03.832547 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:03.832908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:03.833294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:03.836253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:03.848511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:03.850358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:03.860208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1217/2439] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:04.015075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:04.016659 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:04.032917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a47d-0dac-4def-9993-944bcc1f9add service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:04.038361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:04.039380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:04.039666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:04.039936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] PATH_INFO: `/v3/users/9ce6fbb5e7264feb816242192bcbf900` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:04.047851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce6fbb5e7264feb816242192bcbf900)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:04.050237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:04.109546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce6fbb5e7264feb816242192bcbf900'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.110219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce6fbb5e7264feb816242192bcbf900'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.111043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce6fbb5e7264feb816242192bcbf900'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.125029 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce6fbb5e7264feb816242192bcbf900'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.136139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1367a543-bbbf-4905-85f0-d32d8cfd4734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce6fbb5e7264feb816242192bcbf900'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.149982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:04.154395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1223/2440] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:04 2022] DELETE /identity/v3/users/9ce6fbb5e7264feb816242192bcbf900 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:04.374384 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:04.387731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f818430-b59f-4d43-a307-2e90a8132cbc service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:04.449544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:04.470640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:04.472194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:04.472647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:04.472964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] PATH_INFO: `/v3/projects/50b4e3dccbea4d298c769fe999e30d8b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:04.474340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b4e3dccbea4d298c769fe999e30d8b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:04.476929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:04.575725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b4e3dccbea4d298c769fe999e30d8b', 'request_id': 'req-c9c16d19-8f92-42e2-a539-16d5018f791c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.582002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b4e3dccbea4d298c769fe999e30d8b', 'request_id': 'req-c9c16d19-8f92-42e2-a539-16d5018f791c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.608802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b4e3dccbea4d298c769fe999e30d8b', 'request_id': 'req-c9c16d19-8f92-42e2-a539-16d5018f791c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.630670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] The token cache is being invalidate because project 50b4e3dccbea4d298c769fe999e30d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:04.630962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.631637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9c16d19-8f92-42e2-a539-16d5018f791c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:04.633657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1218/2441] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:04 2022] DELETE /identity/v3/projects/50b4e3dccbea4d298c769fe999e30d8b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:04.639489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:04.639720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:04.640017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:04.669765 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:04.671230 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:04.787702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1224/2442] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:04.794649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:04.795142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:04.795614 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:04.831391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:04.833469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:04.845772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1219/2443] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:04.849760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:04.860124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324099-2174-4428-96f4-b6cd21d88705 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:04.864819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:04.868499 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:04.868800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:04.868800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:04.869485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:04.869783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:04.871456 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:04.886098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1225/2444] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:04.890283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:04.900924 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147936e-8e5a-46a8-9454-30af2cbc45d2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:04.907259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:04.908236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:04.908827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:04.909265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:04.909926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:04.912334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:04.963239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1220/2445] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:04 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:04.965176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:04.986710 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac207-f330-4380-a9cd-90f68ab48748 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:05.118247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:05.119544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:05.120010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:05.120438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:05.121250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:05.123391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:05.166071 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1226/2446] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:04 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:05.170063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:05.183712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164001-1ff3-4117-ba20-cf8bc082867d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:05.197023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:05.198462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:05.198462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:05.198462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:05.198834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:05.200542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:05.215432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1221/2447] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:05.216482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:05.239557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107aa1-9964-404d-9bd7-a1b61571194b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:05.258684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bb3be-79a8-4a0d-b9d4-b8dc72232bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:05.259346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb3be-79a8-4a0d-b9d4-b8dc72232bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:05.259628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb3be-79a8-4a0d-b9d4-b8dc72232bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:05.259900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb3be-79a8-4a0d-b9d4-b8dc72232bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:05.260773 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bb3be-79a8-4a0d-b9d4-b8dc72232bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:05.262384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bb3be-79a8-4a0d-b9d4-b8dc72232bcd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:05.419543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1227/2448] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:05.420849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:05.432518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc0a7-2ea8-45b6-8d9f-c68333e071d1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:05.438081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:05.438988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:05.439270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:05.439544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] PATH_INFO: `/v3/projects/2ea20a5931a0474d94d3fe5296799154/users/b361e99551d4460e9e5f1f6e3a0801c5/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:05.457989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea20a5931a0474d94d3fe5296799154, user_id=b361e99551d4460e9e5f1f6e3a0801c5, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:05.460913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:05.478063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1222/2449] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:05 2022] PUT /identity/v3/projects/2ea20a5931a0474d94d3fe5296799154/users/b361e99551d4460e9e5f1f6e3a0801c5/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:05.489292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:05.489759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:05.490243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:05.527278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] MFA Rules not processed for user `b361e99551d4460e9e5f1f6e3a0801c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:05.528748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:05.588572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:05.601233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1228/2450] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:05.612095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:05.614176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:05.721404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ee21-9c45-4053-9525-80380d53d98d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:05.727581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab902a-a6d1-44b3-92e8-fd3ff37e379e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:05.728257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab902a-a6d1-44b3-92e8-fd3ff37e379e service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:05.728541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab902a-a6d1-44b3-92e8-fd3ff37e379e service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:05.728832 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab902a-a6d1-44b3-92e8-fd3ff37e379e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:05.734442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:05.739208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab902a-a6d1-44b3-92e8-fd3ff37e379e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:05.743032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab902a-a6d1-44b3-92e8-fd3ff37e379e service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:05.764955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1223/2451] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:08.041083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:08.042575 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.118464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaeef-fd60-45e6-927a-75a917bb8bee None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:08.123510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:08.124286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.124956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.125075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.129508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.142174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:08.143755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abc52d-e915-4920-ba8b-c1e64cb5876c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:08.153624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1229/2452] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:08.309706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cee66-db79-43cd-b7b5-6c7d33b6ba60 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.310418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cee66-db79-43cd-b7b5-6c7d33b6ba60 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.310418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cee66-db79-43cd-b7b5-6c7d33b6ba60 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.312434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1224/2453] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:26:08.324656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c9c70-a858-4670-adae-9e4066e8bce0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.324982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c9c70-a858-4670-adae-9e4066e8bce0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.325214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c9c70-a858-4670-adae-9e4066e8bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.350775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e23c9c70-a858-4670-adae-9e4066e8bce0 None None] MFA Rules not processed for user `0df436d79943414185c4a6c5c6f9c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:08.352145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e23c9c70-a858-4670-adae-9e4066e8bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.359351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1230/2454] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:26:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:08.372439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cee66-db79-43cd-b7b5-6c7d33b6ba60 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:08.390280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cee66-db79-43cd-b7b5-6c7d33b6ba60 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:08.394177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38d8d-ba3e-46ae-82d4-2bbbc60eb49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:08.394799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38d8d-ba3e-46ae-82d4-2bbbc60eb49c service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.395142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38d8d-ba3e-46ae-82d4-2bbbc60eb49c service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.395421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38d8d-ba3e-46ae-82d4-2bbbc60eb49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.404522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38d8d-ba3e-46ae-82d4-2bbbc60eb49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:08.406083 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38d8d-ba3e-46ae-82d4-2bbbc60eb49c service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:08.428313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1225/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:08.513877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741822-f39c-4329-b54b-4f68be5d1309 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.517553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741822-f39c-4329-b54b-4f68be5d1309 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.518202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741822-f39c-4329-b54b-4f68be5d1309 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.520760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1231/2456] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 17 14:26:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 14:26:08.526469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.526752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.527033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.548995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] MFA Rules not processed for user `11ac5634282f478885ee36f51cf7ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:08.550404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.561613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1226/2457] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Aug 17 14:26:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:08.573814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741822-f39c-4329-b54b-4f68be5d1309 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:08.576249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54741822-f39c-4329-b54b-4f68be5d1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.591699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741822-f39c-4329-b54b-4f68be5d1309 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:08.597754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:08.598972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.599256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.599525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.610811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:08.612939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:08.627744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1232/2458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:08.702718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:08.704202 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.809530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7fd8-fdae-43b7-9c67-33585c7f1cf5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:08.823620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:08.824316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:08.824601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:08.824875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:08.829163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:08.844516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:08.847873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2452b5-bb8d-486b-8cd1-93797c6e5dda service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:08.868983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1227/2459] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:09.141863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:09.242432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec34dc-16e3-4afb-9ba5-14ca89e6a93e service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:09.248149 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:09.248863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:09.249130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:09.249404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] PATH_INFO: `/v3/users/b361e99551d4460e9e5f1f6e3a0801c5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:09.250634 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b361e99551d4460e9e5f1f6e3a0801c5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:09.252724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:09.329314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b361e99551d4460e9e5f1f6e3a0801c5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:09.330453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b361e99551d4460e9e5f1f6e3a0801c5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:09.331495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b361e99551d4460e9e5f1f6e3a0801c5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:09.349434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b361e99551d4460e9e5f1f6e3a0801c5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:09.359084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b361e99551d4460e9e5f1f6e3a0801c5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:09.372027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:09.379786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1233/2460] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:09 2022] DELETE /identity/v3/users/b361e99551d4460e9e5f1f6e3a0801c5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:09.385026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:09.385500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:09.385621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:09.407661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:09.408851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:09.492854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1228/2461] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:09.509047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:09.510453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:09.620059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6a048-a513-4cec-8b69-c8ab79e96b77 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:09.633500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02068df-917a-4502-9c80-439a2bbcc0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:09.634397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02068df-917a-4502-9c80-439a2bbcc0ae service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:09.634866 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02068df-917a-4502-9c80-439a2bbcc0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:09.635296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02068df-917a-4502-9c80-439a2bbcc0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:09.661306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02068df-917a-4502-9c80-439a2bbcc0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:09.667408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02068df-917a-4502-9c80-439a2bbcc0ae service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:09.692871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1234/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:10.202498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.204255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:10.229583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877a798-57a6-4f5a-b75a-5c8138c72bb3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.245017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.245671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.245949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.246223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] PATH_INFO: `/v3/projects/2ea20a5931a0474d94d3fe5296799154` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.247366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea20a5931a0474d94d3fe5296799154)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.249344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.339586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea20a5931a0474d94d3fe5296799154', 'request_id': 'req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:10.350245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea20a5931a0474d94d3fe5296799154', 'request_id': 'req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:10.352838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:10.363046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea20a5931a0474d94d3fe5296799154', 'request_id': 'req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:10.381775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] The token cache is being invalidate because project 2ea20a5931a0474d94d3fe5296799154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:10.382067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:10.382738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4809e1ab-aaa5-4ac8-a43e-d057dfac0f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:10.384531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1229/2463] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:10 2022] DELETE /identity/v3/projects/2ea20a5931a0474d94d3fe5296799154 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:10.389325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.389875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.389875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.410493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:10.412006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:10.489469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1235/2464] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:10.499128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.499686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.499840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.519779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:10.521060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:10.529265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1230/2465] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:10.533694 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.544579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22da0d-79a5-4c40-adb7-dbd35e90c352 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.549270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.549883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.550164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.550435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.551114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:10.551415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.553072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.566135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1236/2466] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:10.570769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.580346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75365-9a12-4b90-ac64-95129a4be838 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.585047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.585649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.585932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.586208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.586830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.588772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.639619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1231/2467] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:10.640967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.651048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6639d-7713-42c0-9710-614b4d3b65b1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.710899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.711508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.711783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.712083 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.712716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.714605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.750772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1237/2468] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:10 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:10.755333 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.768206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b8e9-2e39-4657-a489-c5a1d4a103f0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.776240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.777107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.777561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.778010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.778883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.780840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.793660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1232/2469] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:10.798793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.819911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83144-2f18-4075-b46f-f342b2cd621e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.826099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69104864-e84c-4da8-8a13-4e5ef6ef7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.826808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69104864-e84c-4da8-8a13-4e5ef6ef7f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.827160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69104864-e84c-4da8-8a13-4e5ef6ef7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.827505 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69104864-e84c-4da8-8a13-4e5ef6ef7f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.828297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69104864-e84c-4da8-8a13-4e5ef6ef7f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.830113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69104864-e84c-4da8-8a13-4e5ef6ef7f9b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.844813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1238/2470] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:10.849020 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:10.860358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b68d-f190-404c-8ebd-6ecd4250bddf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:10.865165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:10.865968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.866388 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.866764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] PATH_INFO: `/v3/projects/bdfee76e97e0488fb57aff7efe2b5836/users/4c8148654b304409a50a0838de619885/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.884874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfee76e97e0488fb57aff7efe2b5836, user_id=4c8148654b304409a50a0838de619885, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:10.887704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:10.914293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1233/2471] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:10 2022] PUT /identity/v3/projects/bdfee76e97e0488fb57aff7efe2b5836/users/4c8148654b304409a50a0838de619885/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:10.916042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:10.916328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:10.916602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:10.943352 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:10.976400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] MFA Rules not processed for user `4c8148654b304409a50a0838de619885`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:10.977544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:11.045520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1239/2472] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:11.049964 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.114789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fadda-94ed-4435-911f-e5bf7ab15c72 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.119580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.120228 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.120514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.120786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.121417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.123336 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.153452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1234/2473] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:11 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:11.157682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.171345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ceee-fe8b-4dde-bfd3-1447ca2a75cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.235996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.236637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.237343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.237343 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.237806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.239930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.269142 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1240/2474] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:11 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:11.270965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.285389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a7914-ccbc-4f86-81e6-41f1b1233832 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.297963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.299109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.299607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.300140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.301090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.302943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.322490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1235/2475] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:11.326493 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.338238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bfc90-ec0b-459b-97a7-2ba23334afa6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.341015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.345256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:11.352895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.353636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.353912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.354186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] PATH_INFO: `/v3/projects/8259ef88def64139bfe6ba760366517b/users/a2fd5deaa4044c028415f8992ddebb2b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.373118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8259ef88def64139bfe6ba760366517b, user_id=a2fd5deaa4044c028415f8992ddebb2b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.375620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.396485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1241/2476] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:11 2022] PUT /identity/v3/projects/8259ef88def64139bfe6ba760366517b/users/a2fd5deaa4044c028415f8992ddebb2b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:11.414114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.434884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:11.457788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67f08-2ff7-4e29-8804-2786fd3a92e0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.539902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.540788 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.541021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.541302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.555065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:11.581894 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.587169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.594547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9dce-ee25-4c25-87f3-447b8820e5fa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.604588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef5eb-b074-4172-b9b9-10a5467213f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.605273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef5eb-b074-4172-b9b9-10a5467213f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.605504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef5eb-b074-4172-b9b9-10a5467213f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.605834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef5eb-b074-4172-b9b9-10a5467213f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.606433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ef5eb-b074-4172-b9b9-10a5467213f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.608703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ef5eb-b074-4172-b9b9-10a5467213f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.611127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1236/2477] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:11.612639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:11.632008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1242/2478] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:11.634297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.645542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4b4c-2b32-4c8c-9a3e-8ed0c08abe86 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.652056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.652837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.652999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.653274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] PATH_INFO: `/v3/projects/8259ef88def64139bfe6ba760366517b/users/a2fd5deaa4044c028415f8992ddebb2b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.655508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8259ef88def64139bfe6ba760366517b, user_id=a2fd5deaa4044c028415f8992ddebb2b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:11.658848 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:11.683056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1237/2479] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:11 2022] PUT /identity/v3/projects/8259ef88def64139bfe6ba760366517b/users/a2fd5deaa4044c028415f8992ddebb2b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:11.685435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.685725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.686065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:11.715947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] MFA Rules not processed for user `a2fd5deaa4044c028415f8992ddebb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:11.717226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:11.812076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1243/2480] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:11.823515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:11.825278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:11.919485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcc5f-2385-4e0b-a24d-48c10a113440 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:11.923986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:11.924853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:11.925141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:11.925413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:12.003043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:12.006077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:12.040999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1238/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:14.084255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:14.180041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a4f54-bbbf-44b5-a712-cdef278fcc72 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:14.185619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:14.186241 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:14.186518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:14.186785 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:14.188615 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:14.201638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:14.203246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:14.214311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1244/2482] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:14.674208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:14.675739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:14.687467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c71b-db1c-4ca7-a61c-7116f4a77f8a service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:14.691169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec413-2422-4b36-8c7a-4dca8672d0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:14.691770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec413-2422-4b36-8c7a-4dca8672d0ec service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:14.692097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec413-2422-4b36-8c7a-4dca8672d0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:14.692372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec413-2422-4b36-8c7a-4dca8672d0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:14.702088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ec413-2422-4b36-8c7a-4dca8672d0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:14.703511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ec413-2422-4b36-8c7a-4dca8672d0ec service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:14.713127 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1239/2483] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:17.065927 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:17.067359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:17.136263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab005-a35f-4819-9dd9-d4cabefa9d48 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:17.139946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:17.140623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:17.140905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:17.141178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:17.143089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:17.165779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:17.207089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:17.208559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:17.218111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1245/2484] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:19.323837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:19.324341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:19.324341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:19.343443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:19.344706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:19.349174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:19.403564 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1240/2485] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 17 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:19.416414 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:19.417798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:19.501977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1e5ef-0f3b-41cb-867e-6988f89bb5f3 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:19.507863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:19.508877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:19.508877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:19.509066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:19.517789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:19.519385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:19.531689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1246/2486] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:26:21.995935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:21.997550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:22.014418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0ce0b-dc3a-45d9-8108-e3df1a4d7b23 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:22.019343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:22.020028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:22.020313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:22.020584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] PATH_INFO: `/v3/users/b5872d0410214dd6b44c36c7952a5ea7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:22.021727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5872d0410214dd6b44c36c7952a5ea7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:22.024372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:22.077655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5872d0410214dd6b44c36c7952a5ea7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.085253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5872d0410214dd6b44c36c7952a5ea7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.086159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5872d0410214dd6b44c36c7952a5ea7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.098439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5872d0410214dd6b44c36c7952a5ea7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.106486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a644a2c8-25bf-46ed-8f7c-d6019f13d7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5872d0410214dd6b44c36c7952a5ea7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.112937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1241/2487] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:21 2022] DELETE /identity/v3/users/b5872d0410214dd6b44c36c7952a5ea7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:22.419316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:22.441920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5f1a-cfb4-4e3e-8dbf-f11b0c64e024 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:22.526082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:22.526313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:22.526556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:22.526823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] PATH_INFO: `/v3/projects/613c19b7b0fd4c29b2daa1b26c5d42c3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:22.528284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] RBAC: Authorizing `identity:delete_project(project_id=613c19b7b0fd4c29b2daa1b26c5d42c3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:22.530298 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:22.584292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613c19b7b0fd4c29b2daa1b26c5d42c3', 'request_id': 'req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.585770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:22.591226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613c19b7b0fd4c29b2daa1b26c5d42c3', 'request_id': 'req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.602835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613c19b7b0fd4c29b2daa1b26c5d42c3', 'request_id': 'req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.617723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] The token cache is being invalidate because project 613c19b7b0fd4c29b2daa1b26c5d42c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:22.618347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.618769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca2f9e5a-55b5-4da8-ae12-ac8e3c24602a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:22.620806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1247/2488] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:22 2022] DELETE /identity/v3/projects/613c19b7b0fd4c29b2daa1b26c5d42c3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:22.626039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:22.626360 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:22.626627 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:22.650436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:22.651679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:22.767243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1242/2489] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:22.776303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:22.776303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:22.776754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:22.801636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:22.802874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:22.832266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1248/2490] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:22.836980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:22.848561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e6b71-0f89-4f5d-b846-771ae866f530 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:22.854448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:22.855058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:22.855350 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:22.855612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:22.856314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:22.856620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:22.869428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:22.887623 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1243/2491] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:22.892164 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:22.913728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e51062-27ea-4996-9eb6-dd5edf49e26c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:22.930906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:22.930906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:22.931210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:22.931337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:22.932014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:22.933975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:22.993067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1249/2492] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:22 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:23.000830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.013460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ff5ee-e98e-4d59-a73e-a7c692f3bbca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.026730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:23.114876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.115580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.116171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.116562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.117729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.119351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.155784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.164679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1244/2493] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:22 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:23.172385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503a00-359a-40de-ba66-289608e7a522 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.178353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.179263 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.179758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.180271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.181303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.183147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.214447 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1250/2494] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:23.220991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.230357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cd613-0337-4321-a1c8-314113040976 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.236895 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c64b4-19bb-4295-bcbc-422688566836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.237517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c64b4-19bb-4295-bcbc-422688566836 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.237827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c64b4-19bb-4295-bcbc-422688566836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.238103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c64b4-19bb-4295-bcbc-422688566836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.238918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c64b4-19bb-4295-bcbc-422688566836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.240773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c64b4-19bb-4295-bcbc-422688566836 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.259320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1245/2495] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:23.260406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.271084 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ab3a1-b6d8-4c8e-ba1f-09ce496bd8a3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.277325 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.277951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.278259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.278628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] PATH_INFO: `/v3/projects/921d8998a1354f2496863c2aef12ebca/users/7893d19d71534f3796ceccdd4715f3cc/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.298799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921d8998a1354f2496863c2aef12ebca, user_id=7893d19d71534f3796ceccdd4715f3cc, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.301540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.321126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1251/2496] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:23 2022] PUT /identity/v3/projects/921d8998a1354f2496863c2aef12ebca/users/7893d19d71534f3796ceccdd4715f3cc/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:23.331797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.332491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.332872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.367945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] MFA Rules not processed for user `7893d19d71534f3796ceccdd4715f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:23.369216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:23.458250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1246/2497] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:23.462989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.568833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fada50-46c5-4427-ad5e-e8494b0917c5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.573463 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.574199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.574558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.574910 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.575619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.577758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.608486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1252/2498] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:23 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:23.609775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.622156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c936910-36bb-4b72-8c9b-bd11340a0652 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.695453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.696142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.696428 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.696704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.697341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.699322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.725073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1247/2499] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:23 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:23.726649 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.743554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b44b-6522-428c-a746-9dd5f059b322 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.750255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.750950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.751236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.751510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.752221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.753976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.769448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1253/2500] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:23.770922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.781909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad7e56-7313-4e81-9a97-7f88313623d6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.787380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.788348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.788635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.788916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] PATH_INFO: `/v3/projects/abb0565b4b3c495bba654ed97133fb57/users/61ce007cb52f4b3695904037a02e6f1b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.798262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:23.806742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb0565b4b3c495bba654ed97133fb57, user_id=61ce007cb52f4b3695904037a02e6f1b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.810285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.825178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1248/2501] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:23 2022] PUT /identity/v3/projects/abb0565b4b3c495bba654ed97133fb57/users/61ce007cb52f4b3695904037a02e6f1b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:23.829257 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.841732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a325b8-376a-403c-ab10-1d08ac828e65 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.891771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:23.907656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3199-d16b-45c6-b14f-82401f29c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.908458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3199-d16b-45c6-b14f-82401f29c1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.908904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3199-d16b-45c6-b14f-82401f29c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.909221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3199-d16b-45c6-b14f-82401f29c1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.909990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f3199-d16b-45c6-b14f-82401f29c1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.912119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f3199-d16b-45c6-b14f-82401f29c1c0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.923273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1254/2502] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:23.927773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:23.943433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529214-c02a-47d5-9145-86f85e2eea8d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:23.949655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:23.950363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.950649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.950978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] PATH_INFO: `/v3/projects/abb0565b4b3c495bba654ed97133fb57/users/61ce007cb52f4b3695904037a02e6f1b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:23.953047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb0565b4b3c495bba654ed97133fb57, user_id=61ce007cb52f4b3695904037a02e6f1b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:23.955913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:23.967586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1249/2503] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:23 2022] PUT /identity/v3/projects/abb0565b4b3c495bba654ed97133fb57/users/61ce007cb52f4b3695904037a02e6f1b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:23.978453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:23.980305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:23.980305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:24.015823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] MFA Rules not processed for user `61ce007cb52f4b3695904037a02e6f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:24.017788 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:24.096422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1255/2504] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:24.117798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:24.119816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:24.227748 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e179d0-914e-4d1e-a976-8e32209b9930 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:24.245688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:24.246221 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:24.252572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:24.252876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:24.349068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:24.351287 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:24.364062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1250/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:25.801168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:25.815036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a126d63-34d5-4d5d-801a-ac2edb5b24dd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:25.827176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea147e98-e544-4471-bc89-e651ac16dfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:25.827928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea147e98-e544-4471-bc89-e651ac16dfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:25.828161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea147e98-e544-4471-bc89-e651ac16dfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:25.828446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea147e98-e544-4471-bc89-e651ac16dfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:25.854274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea147e98-e544-4471-bc89-e651ac16dfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:25.855837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea147e98-e544-4471-bc89-e651ac16dfa8 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:25.869247 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1256/2506] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:28.023281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:28.024706 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:28.089508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d50d41-ee57-4df2-921c-be46bb265a99 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:28.094031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:28.094658 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:28.094937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:28.095207 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] PATH_INFO: `/v3/users/4c8148654b304409a50a0838de619885` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:28.096380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8148654b304409a50a0838de619885)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:28.098319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:28.131236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:28.147095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8148654b304409a50a0838de619885'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.154731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8148654b304409a50a0838de619885'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.155403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8148654b304409a50a0838de619885'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.168722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8148654b304409a50a0838de619885'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.177222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8148654b304409a50a0838de619885'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.183626 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1251/2507] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:28 2022] DELETE /identity/v3/users/4c8148654b304409a50a0838de619885 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:28.189200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:28.189702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:28.189975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:28.211818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:28.213096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:28.273922 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1257/2508] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:28.283687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:28.285105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:28.341976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc2ce-2d53-4e73-92c9-fcad73dbf83a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:28.345636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:28.346240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:28.346517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:28.346786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:28.355913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:28.357372 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:28.367048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1252/2509] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:28.639842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:28.641398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:28.656080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9181c-4ac9-4b3b-a2b5-8ff7366843fe None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:28.661627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:28.662824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:28.663349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:28.663636 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] PATH_INFO: `/v3/projects/bdfee76e97e0488fb57aff7efe2b5836` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:28.664833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfee76e97e0488fb57aff7efe2b5836)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:28.666759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:28.715586 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfee76e97e0488fb57aff7efe2b5836', 'request_id': 'req-9bdec340-8478-45e5-a025-b061550d062e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.717718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:28.722113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfee76e97e0488fb57aff7efe2b5836', 'request_id': 'req-9bdec340-8478-45e5-a025-b061550d062e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.733428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfee76e97e0488fb57aff7efe2b5836', 'request_id': 'req-9bdec340-8478-45e5-a025-b061550d062e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.746330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] The token cache is being invalidate because project bdfee76e97e0488fb57aff7efe2b5836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:28.746633 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.747328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.749081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1258/2510] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:28 2022] DELETE /identity/v3/projects/bdfee76e97e0488fb57aff7efe2b5836 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:28.753660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:28.763654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303995a-58f9-47b4-ae0b-fd827f808d41 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:28.823241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:28.823875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:28.824192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:28.824474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] PATH_INFO: `/v3/users/a2fd5deaa4044c028415f8992ddebb2b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:28.825608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fd5deaa4044c028415f8992ddebb2b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:28.827532 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:28.875544 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fd5deaa4044c028415f8992ddebb2b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.880263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:28.884087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fd5deaa4044c028415f8992ddebb2b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.884850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fd5deaa4044c028415f8992ddebb2b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.899035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fd5deaa4044c028415f8992ddebb2b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.905523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-34bdac07-c642-47de-927d-95d620255c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fd5deaa4044c028415f8992ddebb2b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:28.911717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1253/2511] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:28 2022] DELETE /identity/v3/users/a2fd5deaa4044c028415f8992ddebb2b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:29.279098 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.281143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:29.308159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec340-8478-45e5-a025-b061550d062e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.369240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.369961 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.370242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.370506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] PATH_INFO: `/v3/projects/8259ef88def64139bfe6ba760366517b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.371613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8259ef88def64139bfe6ba760366517b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.373583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.422509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8259ef88def64139bfe6ba760366517b', 'request_id': 'req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.428786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8259ef88def64139bfe6ba760366517b', 'request_id': 'req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.436274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8259ef88def64139bfe6ba760366517b', 'request_id': 'req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.448386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] The token cache is being invalidate because project 8259ef88def64139bfe6ba760366517b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:29.448869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.449526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cd915d6d-1fc3-4e2a-9ea3-aba11d2f1e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.451019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1259/2512] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:29 2022] DELETE /identity/v3/projects/8259ef88def64139bfe6ba760366517b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:29.456247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.456715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.456819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.476004 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:29.477230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:29.536505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1254/2513] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:29.544358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0273-f634-4f51-b943-473756c564b6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.544665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0273-f634-4f51-b943-473756c564b6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.544982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0273-f634-4f51-b943-473756c564b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.564705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-045a0273-f634-4f51-b943-473756c564b6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:29.565929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-045a0273-f634-4f51-b943-473756c564b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:29.574488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1260/2514] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:29.578697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.588534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54285dd2-caf5-4d56-89b3-e46911846132 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.593581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.594481 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.594651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.594910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.595593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:29.595942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.597731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.610099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1255/2515] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:29.614416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a0273-f634-4f51-b943-473756c564b6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.624042 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a0273-f634-4f51-b943-473756c564b6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.628597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.629190 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.629485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.629751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.630376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.632937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.660606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1261/2516] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:29.665154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.675081 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a64e0-9204-40bc-be12-3f82a7f9f906 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.730596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.731281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.731560 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.731862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.732518 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.734443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.756577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1256/2517] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:29.760827 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.771045 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3a916-51cd-47fb-aeca-1118472a7909 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.775635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.776319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.776601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.776875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.777545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.779139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.789137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1262/2518] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:29.792839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.803489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb925e8-fbc0-46d0-b1f8-a9207f6aba79 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.808181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.808794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.809069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.809342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.809986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.811610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.823677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1257/2519] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:29.830433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.840629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4008-4303-4479-ac70-20a05680ae97 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.845959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c9c8-ea1e-4d64-804f-314ba468ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.846623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c9c8-ea1e-4d64-804f-314ba468ca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.846901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c9c8-ea1e-4d64-804f-314ba468ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.847169 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c9c8-ea1e-4d64-804f-314ba468ca56 admin admin] PATH_INFO: `/v3/projects/1a52e1ab8d33492a917cc12e58049111/users/55d2337708a042ef94ba82bd6769890c/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.847355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.849176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:29.862819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c9c8-ea1e-4d64-804f-314ba468ca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a52e1ab8d33492a917cc12e58049111, user_id=55d2337708a042ef94ba82bd6769890c, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.863023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58e47-cd64-4c2e-abc3-9cb81a947bd4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:29.866184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c9c8-ea1e-4d64-804f-314ba468ca56 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.868297 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:29.868959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.869263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.869535 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] PATH_INFO: `/v3/users/7893d19d71534f3796ceccdd4715f3cc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.870700 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7893d19d71534f3796ceccdd4715f3cc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:29.872940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:29.880472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1263/2520] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:29 2022] PUT /identity/v3/projects/1a52e1ab8d33492a917cc12e58049111/users/55d2337708a042ef94ba82bd6769890c/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:29.891503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.891857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.892243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.905786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:29.906616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:29.923182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7893d19d71534f3796ceccdd4715f3cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.924836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] MFA Rules not processed for user `55d2337708a042ef94ba82bd6769890c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:29.926228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:29.931194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7893d19d71534f3796ceccdd4715f3cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.931897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7893d19d71534f3796ceccdd4715f3cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.944151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7893d19d71534f3796ceccdd4715f3cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.951610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-51ab895d-460a-493e-bdca-e60473453d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7893d19d71534f3796ceccdd4715f3cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:29.957722 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1258/2521] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:29 2022] DELETE /identity/v3/users/7893d19d71534f3796ceccdd4715f3cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:29.962156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:29.962441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:29.962742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:29.981734 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:29.983108 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:29.992372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1264/2522] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:29.996867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:29.998129 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:30.046842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1259/2523] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:30.060217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.061770 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:30.070917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc540-e14f-4d58-a8de-2d36a67dbdf8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.084039 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.084666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.084947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.085239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.085856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.087963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.121138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1265/2524] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:29 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:30.125311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.135273 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b80fbb-50c2-47e3-b231-41c1b4a1f716 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.193875 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.194515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.194774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.195048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.216098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:30.223668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6b0e0-7ba3-49d9-a15d-d6a43b404ca6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.233170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.234068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.234358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.234630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.235375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.238609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.275890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1266/2525] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:30 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:30.277055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.277769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.279234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.288679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96b11-b534-4ccb-933f-d1ec427e79f8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.293803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.295019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.295305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.295708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.296399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.298085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1260/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:30.298214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.304491 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:30.313663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1267/2527] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:30.315899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.327368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1bbd-93c8-4b8b-bf65-9ece3367578b service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.332252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.332913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.333195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.333473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] PATH_INFO: `/v3/projects/ca9a56347a764c69b38d320516352433/users/55ef3bbf220f4cd39d229d7d0db3423d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.351247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a56347a764c69b38d320516352433, user_id=55ef3bbf220f4cd39d229d7d0db3423d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.354244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.370888 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1261/2528] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:30 2022] PUT /identity/v3/projects/ca9a56347a764c69b38d320516352433/users/55ef3bbf220f4cd39d229d7d0db3423d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:30.375580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.386582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f0da1-78d1-46d8-ab95-e107086eff69 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.453202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc4ae-2550-4ae2-94fe-b8b28db0caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.453874 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc4ae-2550-4ae2-94fe-b8b28db0caac admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.454566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc4ae-2550-4ae2-94fe-b8b28db0caac admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.454843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc4ae-2550-4ae2-94fe-b8b28db0caac admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.455485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defc4ae-2550-4ae2-94fe-b8b28db0caac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.457238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defc4ae-2550-4ae2-94fe-b8b28db0caac admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.476635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1268/2529] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:30.477815 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.491871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ce570-62ef-4d37-9bc8-dccd0d306b57 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.498582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.499382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.500053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.500053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] PATH_INFO: `/v3/projects/ca9a56347a764c69b38d320516352433/users/55ef3bbf220f4cd39d229d7d0db3423d/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.502299 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a56347a764c69b38d320516352433, user_id=55ef3bbf220f4cd39d229d7d0db3423d, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.505016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.526657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1262/2530] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:30 2022] PUT /identity/v3/projects/ca9a56347a764c69b38d320516352433/users/55ef3bbf220f4cd39d229d7d0db3423d/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:30.528721 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.529011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.529289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.560135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] MFA Rules not processed for user `55ef3bbf220f4cd39d229d7d0db3423d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:30.561384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:30.614451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.617188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:30.641163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1269/2531] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:30.653130 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.654754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:30.694630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea5a1-2e97-4cc4-baaf-db4a2ce627d9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.699396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.700064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.700351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.700628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] PATH_INFO: `/v3/projects/921d8998a1354f2496863c2aef12ebca` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.701806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921d8998a1354f2496863c2aef12ebca)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.703737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.715651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e78d2-504f-45c1-8e41-7fc03da0799a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.719305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.720120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.720405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.720680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.733455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.733455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.743766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1270/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:26:30.752385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921d8998a1354f2496863c2aef12ebca', 'request_id': 'req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.758704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921d8998a1354f2496863c2aef12ebca', 'request_id': 'req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.766893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921d8998a1354f2496863c2aef12ebca', 'request_id': 'req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.774236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.779898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] The token cache is being invalidate because project 921d8998a1354f2496863c2aef12ebca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:30.780217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.781690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.783183 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1263/2533] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:30 2022] DELETE /identity/v3/projects/921d8998a1354f2496863c2aef12ebca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:30.787173 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:30.788308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef7de-c06a-4fd7-ab65-8f9fcc520104 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.788483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:30.797270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:30.809377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:30.848779 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.849416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.849720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.849996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] PATH_INFO: `/v3/users/55d2337708a042ef94ba82bd6769890c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.851222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d2337708a042ef94ba82bd6769890c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.854040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.856441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab6d3c-8a7e-4c25-a446-65ee0e82e0a5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:30.861239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:30.861874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.862157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.862432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] PATH_INFO: `/v3/users/61ce007cb52f4b3695904037a02e6f1b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.863582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ce007cb52f4b3695904037a02e6f1b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:30.865579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:30.903224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d2337708a042ef94ba82bd6769890c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.903883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d2337708a042ef94ba82bd6769890c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.904528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d2337708a042ef94ba82bd6769890c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.913154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ce007cb52f4b3695904037a02e6f1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.917566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d2337708a042ef94ba82bd6769890c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.920553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ce007cb52f4b3695904037a02e6f1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.921246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ce007cb52f4b3695904037a02e6f1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.924384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d9dcf88-3bdd-45a3-a5ed-fc3ac065b74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d2337708a042ef94ba82bd6769890c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.935834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ce007cb52f4b3695904037a02e6f1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.939805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1271/2534] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:30 2022] DELETE /identity/v3/users/55d2337708a042ef94ba82bd6769890c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:30.945349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:30.945613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:30.945975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:30.948164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ce007cb52f4b3695904037a02e6f1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:30.954231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1264/2535] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:30 2022] DELETE /identity/v3/users/61ce007cb52f4b3695904037a02e6f1b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:30.964904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:30.966125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.029112 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1272/2536] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:31.039580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.041051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.119304 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446df8e7-1c2f-4896-af40-1640fee82c4a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.123746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b031b-7f21-4557-a08f-9d87b2154607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.124401 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b031b-7f21-4557-a08f-9d87b2154607 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.124687 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b031b-7f21-4557-a08f-9d87b2154607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.124963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b031b-7f21-4557-a08f-9d87b2154607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.134972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b031b-7f21-4557-a08f-9d87b2154607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.136448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b031b-7f21-4557-a08f-9d87b2154607 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.146326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1265/2537] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:31.283024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.284498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.296878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520fc04-b1e4-4579-8cab-08fd8f6afe76 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.301467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.302096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.302375 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.303159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] PATH_INFO: `/v3/projects/abb0565b4b3c495bba654ed97133fb57` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.304473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb0565b4b3c495bba654ed97133fb57)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.306516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.352620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:31.365851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb0565b4b3c495bba654ed97133fb57', 'request_id': 'req-04f0106c-d489-460b-ba89-c2c25982ee67'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.374054 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb0565b4b3c495bba654ed97133fb57', 'request_id': 'req-04f0106c-d489-460b-ba89-c2c25982ee67'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.384324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb0565b4b3c495bba654ed97133fb57', 'request_id': 'req-04f0106c-d489-460b-ba89-c2c25982ee67'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.397614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] The token cache is being invalidate because project abb0565b4b3c495bba654ed97133fb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:31.397614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.398204 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04f0106c-d489-460b-ba89-c2c25982ee67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.400139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1273/2538] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:31 2022] DELETE /identity/v3/projects/abb0565b4b3c495bba654ed97133fb57 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:31.404747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.405259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.405635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.426994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:31.428898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.453822 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:31.497244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1266/2539] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:31.504990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.505274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.505548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.525068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:31.526270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.534711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1274/2540] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:31.539718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.550785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e31d3e-7657-4ca9-aa9e-faf253bfdebf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.556239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.556930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.557167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.557447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.558109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:31.558421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.560153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.576784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1267/2541] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:31.578191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.581101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.586431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.591585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fde2a-dc4e-4c68-ae8f-adb8085c65fb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.598340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.598957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.599233 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.600063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.600687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.602502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fb167-8696-44eb-9c9b-44c28a649e28 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.602642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.608227 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.609010 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.609196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.609465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] PATH_INFO: `/v3/projects/1a52e1ab8d33492a917cc12e58049111` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.610600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a52e1ab8d33492a917cc12e58049111)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.612714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.632836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1275/2542] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:31 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:31.637593 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.662904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a52e1ab8d33492a917cc12e58049111', 'request_id': 'req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.669040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a52e1ab8d33492a917cc12e58049111', 'request_id': 'req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.676539 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a52e1ab8d33492a917cc12e58049111', 'request_id': 'req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.689837 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] The token cache is being invalidate because project 1a52e1ab8d33492a917cc12e58049111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:31.690123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.690767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.692275 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1268/2543] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:31 2022] DELETE /identity/v3/projects/1a52e1ab8d33492a917cc12e58049111 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:31.696039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.697309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.702803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955fdb5-bdf5-4ddd-865a-ed352dbf0769 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.762355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.762736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88828-5fe8-4752-92c9-0ce1853fc7a7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.762966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.763242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.763510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.764160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.766090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.767489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.768157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.768440 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.768711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] PATH_INFO: `/v3/users/55ef3bbf220f4cd39d229d7d0db3423d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.769839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ef3bbf220f4cd39d229d7d0db3423d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.772282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.788337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1276/2544] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:31 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:31.792324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.794742 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.808861 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45fe8-b7d8-4b17-ae1e-8898540b7ed1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.813675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.814359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.814639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.814916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.815565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.817201 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.817488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:31.823398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ef3bbf220f4cd39d229d7d0db3423d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.827895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1277/2545] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:31.831942 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.834965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ef3bbf220f4cd39d229d7d0db3423d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.835916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ef3bbf220f4cd39d229d7d0db3423d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.842613 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc0f8d-b127-42e4-925f-f4b71b567002 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.847191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.847783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.848101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.848377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.848570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ef3bbf220f4cd39d229d7d0db3423d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.849020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.851160 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.856589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-76b51cd4-99d8-4d92-ab01-338a3f9f7fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ef3bbf220f4cd39d229d7d0db3423d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:31.862592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1278/2546] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:31.863130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1269/2547] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:31 2022] DELETE /identity/v3/users/55ef3bbf220f4cd39d229d7d0db3423d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:31.866840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:31.868531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:31.881117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9a21-324c-4e71-bed9-67c589845fac admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:31.891944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:31.948178 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:31.948958 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.949310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.949666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] PATH_INFO: `/v3/projects/3241ecb9ef95472391f4c311f372698f/users/3847a7d90fa64c36827cd323f63d4713/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:31.965652 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3241ecb9ef95472391f4c311f372698f, user_id=3847a7d90fa64c36827cd323f63d4713, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:31.968609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:31.986146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1279/2548] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:31 2022] PUT /identity/v3/projects/3241ecb9ef95472391f4c311f372698f/users/3847a7d90fa64c36827cd323f63d4713/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:31.996836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:31.997053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:31.997330 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.026659 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] MFA Rules not processed for user `3847a7d90fa64c36827cd323f63d4713`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:32.027994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:32.107681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1270/2549] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:32.112031 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.166424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.167845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:32.203998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1998a-039f-4d0c-b09f-d685abec6d06 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.211097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.211803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.212180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.212566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.213670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.215452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.248559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1280/2550] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:32.252483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.263741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cac79-3f16-4164-aa7c-c2fab37057cb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.323128 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:32.325359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7dcee-1b7c-4d18-81e8-d3a9493d7f15 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.332853 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.334526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.335427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.336042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] PATH_INFO: `/v3/projects/ca9a56347a764c69b38d320516352433` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.338267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9a56347a764c69b38d320516352433)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.338898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.339618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.339999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.340517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.341249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.341773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.343523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.368008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1281/2551] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:32.371485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.383001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8c80d-3548-438d-bca1-31e8f4f8e68d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.389983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.390856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.391286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.391657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.392482 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.394147 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.403101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:32.424068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1282/2552] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:32.432193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.455098 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9a56347a764c69b38d320516352433', 'request_id': 'req-d1878d8d-4773-4b81-924c-d97b2c000605'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:32.466783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9a56347a764c69b38d320516352433', 'request_id': 'req-d1878d8d-4773-4b81-924c-d97b2c000605'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:32.471431 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c452-3e66-46c8-bac4-8922ba3e6611 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.527851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9a56347a764c69b38d320516352433', 'request_id': 'req-d1878d8d-4773-4b81-924c-d97b2c000605'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:32.557708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] The token cache is being invalidate because project ca9a56347a764c69b38d320516352433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:32.557999 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:32.558754 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d1878d8d-4773-4b81-924c-d97b2c000605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:32.560648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1271/2553] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:32 2022] DELETE /identity/v3/projects/ca9a56347a764c69b38d320516352433 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:32.562855 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.563495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.563856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.564166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.564811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.565580 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0d7b-7ff4-4e84-be52-b11d2d8afade None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.565872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0d7b-7ff4-4e84-be52-b11d2d8afade None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.566151 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0d7b-7ff4-4e84-be52-b11d2d8afade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.566420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.577022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1283/2554] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:32.581011 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.582654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:32.586356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-abca0d7b-7ff4-4e84-be52-b11d2d8afade None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:32.589137 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-abca0d7b-7ff4-4e84-be52-b11d2d8afade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:32.595568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee554-9583-4bfa-8856-86943a5c4432 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.597912 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1272/2555] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:32.601103 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06e147-210c-48fd-a2c0-04162bcf08c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.601761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e147-210c-48fd-a2c0-04162bcf08c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.602047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e147-210c-48fd-a2c0-04162bcf08c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.602315 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e147-210c-48fd-a2c0-04162bcf08c4 admin admin] PATH_INFO: `/v3/projects/9df5c6e7d3a041dca945699b86b6f12a/users/aba66686d02d4e99971bde727da45d07/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.605609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.606663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.606663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.618691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06e147-210c-48fd-a2c0-04162bcf08c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df5c6e7d3a041dca945699b86b6f12a, user_id=aba66686d02d4e99971bde727da45d07, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.621405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06e147-210c-48fd-a2c0-04162bcf08c4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.626749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:32.628121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:32.637198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1284/2556] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:32 2022] PUT /identity/v3/projects/9df5c6e7d3a041dca945699b86b6f12a/users/aba66686d02d4e99971bde727da45d07/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:32.651656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.652250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.652677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.685725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] MFA Rules not processed for user `aba66686d02d4e99971bde727da45d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:32.688059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:32.691636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1273/2557] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:32.696639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.706278 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929d27-a35c-43af-98fe-1cde53b56a0e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.712329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.712678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.713027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.713485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.714257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:32.714633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.716335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.740640 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1274/2558] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:26:32.744717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.758443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0fdb4-a6ba-40d0-b984-c41ac2a8a461 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.763445 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.764169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.764719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.765047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.765737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.767878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.794156 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1285/2559] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:32.798707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.805877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1275/2560] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:32.806655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.811629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa5144-0b57-42d1-9cb8-9a912260deaa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.856767 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:32.875301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498602-6bfa-49b7-80e7-a53703b91ed4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.878797 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.879478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.879699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.879989 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.880113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.880638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.880756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.880914 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.881186 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.881795 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.882579 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.883702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.887860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:32.904887 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1276/2561] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:32.909171 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.911517 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1286/2562] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:32.915708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:32.919793 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d2dda-9af9-4fdb-b0a0-67f190a7a0cf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.976504 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f20548-f651-4c93-86a1-631784f0c8d1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:32.976968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.977649 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.977993 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.978329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.979040 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.980751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.981470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:32.982087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:32.982483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:32.982951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:32.983372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:32.985378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:32.994462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1277/2563] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:32.995587 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.005479 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e92f-4ce4-4e15-8949-130244a62f85 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.007984 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1287/2564] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:32 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:33.010483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.011496 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.011785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.011891 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.012107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.012906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.014533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.021438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b676f47-5c5d-41dc-b534-4eacee1b0613 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.028404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1278/2565] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:33.028535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.028535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.028535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.028535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.028925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.029354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.029461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.039731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941cada-fc10-4e7c-be3c-85e221cf5de7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.040516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1288/2566] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:33.044503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.044637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3f82e-482e-4b13-a2f0-b1147f6ec7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.045153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f82e-482e-4b13-a2f0-b1147f6ec7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.045431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f82e-482e-4b13-a2f0-b1147f6ec7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.045705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f82e-482e-4b13-a2f0-b1147f6ec7f0 admin admin] PATH_INFO: `/v3/projects/fb0813ec32c64e7ba180f2ad7a6f01bc/users/3889fb1cec254b41b8db8a437ed8ab48/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.054703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d0b2a-6560-4c8b-a86b-66cd52c318c3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.059545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.060220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.060502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.060772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] PATH_INFO: `/v3/projects/f329ecaf0ad345489c4736934f3186b6/users/bceeb2f6331b4ede908dcf4c41ffdc9f/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.061184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f82e-482e-4b13-a2f0-b1147f6ec7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0813ec32c64e7ba180f2ad7a6f01bc, user_id=3889fb1cec254b41b8db8a437ed8ab48, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.063840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f82e-482e-4b13-a2f0-b1147f6ec7f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.075474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f329ecaf0ad345489c4736934f3186b6, user_id=bceeb2f6331b4ede908dcf4c41ffdc9f, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.076571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1279/2567] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:33 2022] PUT /identity/v3/projects/fb0813ec32c64e7ba180f2ad7a6f01bc/users/3889fb1cec254b41b8db8a437ed8ab48/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:33.085635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.087303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.087595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.087865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.094747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1289/2568] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:33 2022] PUT /identity/v3/projects/f329ecaf0ad345489c4736934f3186b6/users/bceeb2f6331b4ede908dcf4c41ffdc9f/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:33.095626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.118674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] MFA Rules not processed for user `3889fb1cec254b41b8db8a437ed8ab48`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:33.119925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.162430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25f68-d257-4cec-aded-3eda80ed90d0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.168535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.169144 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.169425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.169698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.170340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.171947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.182345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1290/2569] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:33.186420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1280/2570] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:33.186619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.196170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d16cf-fcb0-4aa4-aacd-105fdfb85004 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.197051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.198377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.200847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8bf8-e2c6-496d-bd0b-0f203f01770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.201488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8bf8-e2c6-496d-bd0b-0f203f01770e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.201769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8bf8-e2c6-496d-bd0b-0f203f01770e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.202040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8bf8-e2c6-496d-bd0b-0f203f01770e admin admin] PATH_INFO: `/v3/projects/f329ecaf0ad345489c4736934f3186b6/users/bceeb2f6331b4ede908dcf4c41ffdc9f/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.203971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8bf8-e2c6-496d-bd0b-0f203f01770e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f329ecaf0ad345489c4736934f3186b6, user_id=bceeb2f6331b4ede908dcf4c41ffdc9f, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.206626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8bf8-e2c6-496d-bd0b-0f203f01770e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.217195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1291/2571] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:33 2022] PUT /identity/v3/projects/f329ecaf0ad345489c4736934f3186b6/users/bceeb2f6331b4ede908dcf4c41ffdc9f/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:33.226303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:33.227736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.228150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.228408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.257529 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749e77c-50c2-4270-bab9-1b9b976b1ee5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.258829 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] MFA Rules not processed for user `bceeb2f6331b4ede908dcf4c41ffdc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:33.260092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.272749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:33.307794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.308368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.308780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.309058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.334224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1292/2572] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:33.345591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.346981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.359271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65764b-9389-43b0-a3d1-bc43a751fc18 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.362873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.363467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.363744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.364043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.368033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.369514 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.373707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.375355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.378502 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1281/2573] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:26:33.385223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1293/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:26:33.400589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.431475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.440376 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee139b-296e-4d2e-9f80-c23fdec32eff service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.444078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.444672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.444951 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.445218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.446943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.468582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0af1c-68ba-4fd0-b051-128d1f3067e9 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.473259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.473882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.474165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.474986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] PATH_INFO: `/v3/users/3889fb1cec254b41b8db8a437ed8ab48` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.476156 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3889fb1cec254b41b8db8a437ed8ab48)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.478091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.507312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.508993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbdb3-b425-48b7-bf77-7d5d405bea47 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.517030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:33.518392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1294/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:33.526812 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3889fb1cec254b41b8db8a437ed8ab48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:33.533645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3889fb1cec254b41b8db8a437ed8ab48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:33.534354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3889fb1cec254b41b8db8a437ed8ab48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:33.550931 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3889fb1cec254b41b8db8a437ed8ab48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:33.558230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3889fb1cec254b41b8db8a437ed8ab48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:33.564320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1282/2576] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:33 2022] DELETE /identity/v3/users/3889fb1cec254b41b8db8a437ed8ab48 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:33.569635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad905dcf-d1f4-40d4-bee1-560da41fa6cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.569926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad905dcf-d1f4-40d4-bee1-560da41fa6cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.569926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad905dcf-d1f4-40d4-bee1-560da41fa6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.590143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ad905dcf-d1f4-40d4-bee1-560da41fa6cf None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:33.591355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ad905dcf-d1f4-40d4-bee1-560da41fa6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.650172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1295/2577] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:33.659974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:33.661663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:33.724979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3f6b-2895-4e73-8f8b-a30ae0dc04d8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:33.728710 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:33.729318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.729603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.729879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.740175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:33.741716 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:33.751909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1283/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:33.949700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:33.950484 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:33.951116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:33.973346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] MFA Rules not processed for user `7bbe8721fc10483f9502fc3011ab4e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:33.974789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:34.010109 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:34.039238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1296/2579] 10.222.0.23 () {58 vars in 967 bytes} [Wed Aug 17 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:34.051774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.053876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:34.068928 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.070623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:34.095983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a38f-3cd7-44d1-a1b0-2bfb5b1dd362 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.100732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.101371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.101656 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.101929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] PATH_INFO: `/v3/projects/fb0813ec32c64e7ba180f2ad7a6f01bc` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.103062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0813ec32c64e7ba180f2ad7a6f01bc)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.105073 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.135766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e13fc-2760-4ba0-b613-d0d35d961bbb service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.141322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0159e1-86ba-4c9b-95e9-bc554b4a961f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3280a3468db42b29ce76accc1458f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.141939 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0159e1-86ba-4c9b-95e9-bc554b4a961f service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.142220 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0159e1-86ba-4c9b-95e9-bc554b4a961f service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.142500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0159e1-86ba-4c9b-95e9-bc554b4a961f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.151067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0159e1-86ba-4c9b-95e9-bc554b4a961f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.152998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0159e1-86ba-4c9b-95e9-bc554b4a961f service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.157808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0813ec32c64e7ba180f2ad7a6f01bc', 'request_id': 'req-6774b27d-a92c-4bb2-baed-416709ea24d2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:34.162972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1284/2580] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Aug 17 14:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 14:26:34.164242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0813ec32c64e7ba180f2ad7a6f01bc', 'request_id': 'req-6774b27d-a92c-4bb2-baed-416709ea24d2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:34.172405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0813ec32c64e7ba180f2ad7a6f01bc', 'request_id': 'req-6774b27d-a92c-4bb2-baed-416709ea24d2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:34.184640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] The token cache is being invalidate because project fb0813ec32c64e7ba180f2ad7a6f01bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:34.185061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:34.185784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6774b27d-a92c-4bb2-baed-416709ea24d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:34.187283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1297/2581] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:34 2022] DELETE /identity/v3/projects/fb0813ec32c64e7ba180f2ad7a6f01bc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:34.192072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.192370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.192646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.213840 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:34.215149 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:34.261798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:34.285957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1285/2582] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:34.294466 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.294755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.295027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.319314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:34.321035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:34.333337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1298/2583] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:34.337762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.347517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb885aa-d84d-4853-a651-ef667ead1b5c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.352890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.353506 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.353784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.354054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.354699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:34.355007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.356633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.369076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1286/2584] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:34.373599 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.382906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344f5b-f757-4a2c-b6b0-9cc7bad1978f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.387715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.388336 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.388611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.388878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.389489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.391385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.417766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1299/2585] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:34.421973 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.432792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5d53c-53ee-4771-a9b6-0a04db5b0777 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.493292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.493925 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.494208 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.494475 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.495109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.497079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.518132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1287/2586] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:34.522322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.532748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1f35-f69f-4a29-8fe8-bdb6599ef6f7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.538030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.538627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.538896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.539159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.539792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.541478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.551853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1300/2587] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:34.556561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.566597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13188f5-a89d-405e-88b5-6aaeae405583 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.571708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126b487-6b9c-4938-a9b6-302753cf709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.572417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b487-6b9c-4938-a9b6-302753cf709b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.572698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b487-6b9c-4938-a9b6-302753cf709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.572967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b487-6b9c-4938-a9b6-302753cf709b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.573606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b487-6b9c-4938-a9b6-302753cf709b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.575245 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b487-6b9c-4938-a9b6-302753cf709b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.586044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1288/2588] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:34.590170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.600531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4725-6ecc-49d5-b5e6-c371331cfabe admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.605105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.605745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.606021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.606286 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] PATH_INFO: `/v3/projects/cd65b46d285f480fb35cfb10784aa1b7/users/01144d0150694729a10da8f2a9d56e58/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.620917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd65b46d285f480fb35cfb10784aa1b7, user_id=01144d0150694729a10da8f2a9d56e58, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.623542 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.636926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1301/2589] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:34 2022] PUT /identity/v3/projects/cd65b46d285f480fb35cfb10784aa1b7/users/01144d0150694729a10da8f2a9d56e58/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:34.647054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.647344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.647620 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.675768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] MFA Rules not processed for user `01144d0150694729a10da8f2a9d56e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:34.677069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:34.742666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1289/2590] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:34.747167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.807968 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ffa07-598d-4f8c-ba06-87cd3b9f1482 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.812620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.813221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.813573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.814024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.815104 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.818863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.823538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:34.847944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1302/2591] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:34.852690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.863347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d50ca-ccd9-4f08-8c24-1d61dc70f95b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.902933 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:34.921184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.921996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.922358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.922635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.923268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.925212 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.951007 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1290/2592] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:34 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:34.952489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:34.964911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e811-9ef4-43fc-b3a4-763dea81c2b4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:34.971565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:34.972205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:34.972637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:34.972913 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:34.973563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:34.975733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:34.989072 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1303/2593] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:34.990461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:35.001771 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e79e3-747c-456d-bd2c-975c897a0126 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:35.007001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:35.007665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:35.007994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:35.008286 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] PATH_INFO: `/v3/projects/0b797e3167934bec8dcc03b8558838b9/users/cfcbfcee37b548edaa93c6a125d9ade1/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:35.025459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b797e3167934bec8dcc03b8558838b9, user_id=cfcbfcee37b548edaa93c6a125d9ade1, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:35.026693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:35.046522 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1291/2594] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:34 2022] PUT /identity/v3/projects/0b797e3167934bec8dcc03b8558838b9/users/cfcbfcee37b548edaa93c6a125d9ade1/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:35.050303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:35.060930 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158bcf-1e81-4d33-981c-728a0667f196 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:35.136767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a01cd-7438-4645-807d-6ee4efb5fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:35.136767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a01cd-7438-4645-807d-6ee4efb5fd1b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:35.137221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a01cd-7438-4645-807d-6ee4efb5fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:35.137221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a01cd-7438-4645-807d-6ee4efb5fd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:35.137933 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a01cd-7438-4645-807d-6ee4efb5fd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:35.139612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a01cd-7438-4645-807d-6ee4efb5fd1b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:35.154510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1304/2595] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:35.159106 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:35.178236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4d6b-895b-40f1-bc8d-cb5b0bce4377 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:35.184461 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:35.185131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:35.185411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:35.185690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] PATH_INFO: `/v3/projects/0b797e3167934bec8dcc03b8558838b9/users/cfcbfcee37b548edaa93c6a125d9ade1/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:35.188501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b797e3167934bec8dcc03b8558838b9, user_id=cfcbfcee37b548edaa93c6a125d9ade1, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:35.192057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:35.204747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1292/2596] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:35 2022] PUT /identity/v3/projects/0b797e3167934bec8dcc03b8558838b9/users/cfcbfcee37b548edaa93c6a125d9ade1/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:35.215851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:35.216176 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:35.216454 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:35.247341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] MFA Rules not processed for user `cfcbfcee37b548edaa93c6a125d9ade1`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:35.248767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:35.321210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1305/2597] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:35.331849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:35.334262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:35.392692 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5e68-dd10-4e68-85ae-9c92f090e783 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:35.396900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84053-dcf7-473d-b861-a4ebd0660541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:35.397510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84053-dcf7-473d-b861-a4ebd0660541 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:35.397783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84053-dcf7-473d-b861-a4ebd0660541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:35.398048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84053-dcf7-473d-b861-a4ebd0660541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:35.457802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84053-dcf7-473d-b861-a4ebd0660541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:35.459842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84053-dcf7-473d-b861-a4ebd0660541 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:35.468868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1293/2598] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:36.447235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:36.448648 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:36.508383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:36.515082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f9e5-3a2f-4670-a83a-fb98934d97e8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:36.519753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:36.520448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:36.520732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:36.521009 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] PATH_INFO: `/v3/users/3847a7d90fa64c36827cd323f63d4713` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:36.522124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3847a7d90fa64c36827cd323f63d4713)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:36.524140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:36.569581 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3847a7d90fa64c36827cd323f63d4713'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:36.570226 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3847a7d90fa64c36827cd323f63d4713'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:36.570835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3847a7d90fa64c36827cd323f63d4713'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:36.582711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3847a7d90fa64c36827cd323f63d4713'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:36.589486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3847a7d90fa64c36827cd323f63d4713'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:36.602608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1306/2599] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:36 2022] DELETE /identity/v3/users/3847a7d90fa64c36827cd323f63d4713 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:36.607172 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:36.607642 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:36.607762 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:36.627749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:36.628945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:36.671495 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:36.687823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1294/2600] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:36.697361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:36.698756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:36.755628 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c6450-a17b-4a9b-9da4-c43d919c308b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:36.759358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:36.760030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:36.760314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:36.760592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:36.770337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:36.771824 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:36.781361 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1307/2601] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:37.055524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:37.057092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:37.071995 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80086524-a4d8-42f3-9a5e-8065446890fe None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:37.077512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:37.078337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:37.078484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:37.078751 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] PATH_INFO: `/v3/projects/3241ecb9ef95472391f4c311f372698f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:37.079978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3241ecb9ef95472391f4c311f372698f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:37.082449 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:37.132983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3241ecb9ef95472391f4c311f372698f', 'request_id': 'req-42a4db04-3f20-4b64-a035-f50ad93b3949'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.139056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3241ecb9ef95472391f4c311f372698f', 'request_id': 'req-42a4db04-3f20-4b64-a035-f50ad93b3949'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.148369 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3241ecb9ef95472391f4c311f372698f', 'request_id': 'req-42a4db04-3f20-4b64-a035-f50ad93b3949'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.159790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] The token cache is being invalidate because project 3241ecb9ef95472391f4c311f372698f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:37.160120 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.161024 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.163095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1295/2602] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:37 2022] DELETE /identity/v3/projects/3241ecb9ef95472391f4c311f372698f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:37.167063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:37.176873 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2357-7b25-4b7f-848a-584fa46fb5f8 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:37.235238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:37.235857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:37.236163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:37.236431 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] PATH_INFO: `/v3/users/aba66686d02d4e99971bde727da45d07` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:37.237596 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba66686d02d4e99971bde727da45d07)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:37.239522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:37.260274 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:37.288646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba66686d02d4e99971bde727da45d07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.289297 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba66686d02d4e99971bde727da45d07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.289901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba66686d02d4e99971bde727da45d07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.301677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba66686d02d4e99971bde727da45d07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.308380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba66686d02d4e99971bde727da45d07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.321616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1308/2603] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:37 2022] DELETE /identity/v3/users/aba66686d02d4e99971bde727da45d07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:37.847664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:37.849216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:37.862293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4db04-3f20-4b64-a035-f50ad93b3949 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:37.917852 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:37.918485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:37.918768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:37.919041 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] PATH_INFO: `/v3/projects/9df5c6e7d3a041dca945699b86b6f12a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:37.920196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df5c6e7d3a041dca945699b86b6f12a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:37.922117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:37.974908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df5c6e7d3a041dca945699b86b6f12a', 'request_id': 'req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.980311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df5c6e7d3a041dca945699b86b6f12a', 'request_id': 'req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.987284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df5c6e7d3a041dca945699b86b6f12a', 'request_id': 'req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.999030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] The token cache is being invalidate because project 9df5c6e7d3a041dca945699b86b6f12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:37.999323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:37.999983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.001468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1296/2604] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:37 2022] DELETE /identity/v3/projects/9df5c6e7d3a041dca945699b86b6f12a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:38.006005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.007460 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.020507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855b679-24d3-4b68-a410-3ee362909aca admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.020644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.021918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.026928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:38.079982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.080621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.080932 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.081206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] PATH_INFO: `/v3/users/bceeb2f6331b4ede908dcf4c41ffdc9f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.082333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bceeb2f6331b4ede908dcf4c41ffdc9f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.084314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.091694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e93b2-6dcb-4804-87c1-1425e9fbdb09 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.096296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.096934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.097213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.097486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] PATH_INFO: `/v3/users/01144d0150694729a10da8f2a9d56e58` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.098619 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01144d0150694729a10da8f2a9d56e58)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.101101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.133051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bceeb2f6331b4ede908dcf4c41ffdc9f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.133731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bceeb2f6331b4ede908dcf4c41ffdc9f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.134395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bceeb2f6331b4ede908dcf4c41ffdc9f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.147667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bceeb2f6331b4ede908dcf4c41ffdc9f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.148625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01144d0150694729a10da8f2a9d56e58'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.154921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a6c74cc5-6f22-4520-83cf-a723f1dc5ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bceeb2f6331b4ede908dcf4c41ffdc9f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.155671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01144d0150694729a10da8f2a9d56e58'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.156474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01144d0150694729a10da8f2a9d56e58'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.168661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1309/2605] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:38 2022] DELETE /identity/v3/users/bceeb2f6331b4ede908dcf4c41ffdc9f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:38.169976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01144d0150694729a10da8f2a9d56e58'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.183088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01144d0150694729a10da8f2a9d56e58'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.190434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1297/2606] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:38 2022] DELETE /identity/v3/users/01144d0150694729a10da8f2a9d56e58 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:38.195139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.195426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.195702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.215918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:38.217173 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.228841 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:38.285066 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1310/2607] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:38.296113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.297524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.361357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fcdc9-e904-4b6f-a61d-c741cd97a5d1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.365666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902b44c-f7eb-4d23-a434-cee1f9f66876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.366585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902b44c-f7eb-4d23-a434-cee1f9f66876 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.366585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902b44c-f7eb-4d23-a434-cee1f9f66876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.366827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902b44c-f7eb-4d23-a434-cee1f9f66876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.376600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902b44c-f7eb-4d23-a434-cee1f9f66876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.378112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902b44c-f7eb-4d23-a434-cee1f9f66876 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.388180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1298/2608] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:26:38.448287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.449849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.463205 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535e006-5195-4878-918e-2140d6d3c762 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.469199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.469976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.470328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.470712 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] PATH_INFO: `/v3/projects/f329ecaf0ad345489c4736934f3186b6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.472001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f329ecaf0ad345489c4736934f3186b6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.474070 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.526907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f329ecaf0ad345489c4736934f3186b6', 'request_id': 'req-8450bac6-63e4-43fa-acbc-fe66dab076fa'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.532884 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f329ecaf0ad345489c4736934f3186b6', 'request_id': 'req-8450bac6-63e4-43fa-acbc-fe66dab076fa'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.541429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f329ecaf0ad345489c4736934f3186b6', 'request_id': 'req-8450bac6-63e4-43fa-acbc-fe66dab076fa'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.552748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] The token cache is being invalidate because project f329ecaf0ad345489c4736934f3186b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:38.553035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.553679 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8450bac6-63e4-43fa-acbc-fe66dab076fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.556187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1311/2609] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:38 2022] DELETE /identity/v3/projects/f329ecaf0ad345489c4736934f3186b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:38.562963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.563324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.563691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.584356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:38.585565 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.605165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:38.647779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1299/2610] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:38.656137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.656425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.656700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.677006 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:38.678753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.691947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.692307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1312/2611] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:38.693971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.695437 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.702244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb16bd-5f73-43d8-8dac-a34cb5446007 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.706917 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.707528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.707804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.708111 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.708798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:38.708918 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e013e-6c09-4e8f-bf6f-b13dc383149e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.709236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.710862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.714246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.714954 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.715303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.715644 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] PATH_INFO: `/v3/projects/cd65b46d285f480fb35cfb10784aa1b7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.716876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd65b46d285f480fb35cfb10784aa1b7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.718869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.724285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1300/2612] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:38.727613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.739085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f841d7-f426-4d26-bdea-9e994b4ae68e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.744612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.745289 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.745949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.745949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.746794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.748747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.774995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd65b46d285f480fb35cfb10784aa1b7', 'request_id': 'req-7aadff75-1837-4906-9d9c-5755b80a9d1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.779996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1301/2613] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:38 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:38.780746 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd65b46d285f480fb35cfb10784aa1b7', 'request_id': 'req-7aadff75-1837-4906-9d9c-5755b80a9d1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.782067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.788889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd65b46d285f480fb35cfb10784aa1b7', 'request_id': 'req-7aadff75-1837-4906-9d9c-5755b80a9d1d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.800734 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] The token cache is being invalidate because project cd65b46d285f480fb35cfb10784aa1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:38.801019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.801699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.803732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1313/2614] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:38 2022] DELETE /identity/v3/projects/cd65b46d285f480fb35cfb10784aa1b7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:38.807467 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.808819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.827428 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:38.846498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021323a-56b6-41a4-8308-438bf95575fb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.852306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.853047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.853648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.853648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.854260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.856252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.875737 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadff75-1837-4906-9d9c-5755b80a9d1d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.881566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1302/2615] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:38 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:38.881724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.881724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.881724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.881724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] PATH_INFO: `/v3/users/cfcbfcee37b548edaa93c6a125d9ade1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.882755 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcbfcee37b548edaa93c6a125d9ade1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.882943 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.884503 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.884723 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.896345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4aac-6a73-4c66-9934-3b5f9073329b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.901006 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.901584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.901866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.902140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.902786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.904398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.918742 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1303/2616] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:38.919774 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.930113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4955-f686-4e60-9197-68f426d3945d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.933981 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcbfcee37b548edaa93c6a125d9ade1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.934625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcbfcee37b548edaa93c6a125d9ade1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.934739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.935250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcbfcee37b548edaa93c6a125d9ade1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.935363 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.935563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.935834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.936521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.938085 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:38.947341 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcbfcee37b548edaa93c6a125d9ade1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.949562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1304/2617] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:38.953434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:38.955131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:38.957550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfaef1b0-f43f-4024-9524-c275f601e43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcbfcee37b548edaa93c6a125d9ade1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:38.967910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddaa3c-4018-43c5-8323-86ae37cbfd61 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:38.970291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1314/2618] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:38 2022] DELETE /identity/v3/users/cfcbfcee37b548edaa93c6a125d9ade1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:38.973315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:38.974425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:38.974679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:38.974951 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] PATH_INFO: `/v3/projects/73227eef79834ccfb6231b6a2759dc52/users/6c7235ac41df44beb0e3aa3d96ed2ffe/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:38.990527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73227eef79834ccfb6231b6a2759dc52, user_id=6c7235ac41df44beb0e3aa3d96ed2ffe, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:38.993166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.007033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1305/2619] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:38 2022] PUT /identity/v3/projects/73227eef79834ccfb6231b6a2759dc52/users/6c7235ac41df44beb0e3aa3d96ed2ffe/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:39.019111 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.019658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.019745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.049881 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] MFA Rules not processed for user `6c7235ac41df44beb0e3aa3d96ed2ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:39.051213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.123642 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1315/2620] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:39.128234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.164421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:39.194954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3719f3-7acb-4171-9669-1b874fdbbb72 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.199632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.200267 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.200545 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.200813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.201437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.203467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.233054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1306/2621] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:39.237242 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.249237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c1866-b6a5-49d1-bdb8-189278e1d265 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.256798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.259051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.288654 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:39.334372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.335062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.335340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.335658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.336327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.338439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.338583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d22ed-9d8e-489d-964a-87de0b55548a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.343476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.344271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.344644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.344988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] PATH_INFO: `/v3/projects/0b797e3167934bec8dcc03b8558838b9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.346274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b797e3167934bec8dcc03b8558838b9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.348418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.364434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1316/2622] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:39.368600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.379512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0e34-c4d1-4703-97cf-868db548104b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.385496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.386152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.386403 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.386670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.387337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.389021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.401489 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1317/2623] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:39.405813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.412967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b797e3167934bec8dcc03b8558838b9', 'request_id': 'req-cfa601d6-5cba-43b9-bead-0013fda7a4af'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:39.417614 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdc911-1051-4257-b928-9d2bb7494c8d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.419167 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b797e3167934bec8dcc03b8558838b9', 'request_id': 'req-cfa601d6-5cba-43b9-bead-0013fda7a4af'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:39.427930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b797e3167934bec8dcc03b8558838b9', 'request_id': 'req-cfa601d6-5cba-43b9-bead-0013fda7a4af'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:39.441827 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] The token cache is being invalidate because project 0b797e3167934bec8dcc03b8558838b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:39.442121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:39.442834 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cfa601d6-5cba-43b9-bead-0013fda7a4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:39.444635 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1307/2624] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:39 2022] DELETE /identity/v3/projects/0b797e3167934bec8dcc03b8558838b9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:39.449394 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f407-6e56-456c-b4c5-939759081515 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.449688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f407-6e56-456c-b4c5-939759081515 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.449966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f407-6e56-456c-b4c5-939759081515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.469910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fe13f407-6e56-456c-b4c5-939759081515 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:39.471113 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe13f407-6e56-456c-b4c5-939759081515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.480496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.481158 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.481442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.481715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] PATH_INFO: `/v3/projects/33def8e59e9d4ff6adac30260c689032/users/0aa9b52cb5b7486c94c76827c87dd837/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.496660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=33def8e59e9d4ff6adac30260c689032, user_id=0aa9b52cb5b7486c94c76827c87dd837, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.499767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.512639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1318/2625] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:39 2022] PUT /identity/v3/projects/33def8e59e9d4ff6adac30260c689032/users/0aa9b52cb5b7486c94c76827c87dd837/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:39.516854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:39.517021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.518657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.534965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1308/2626] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:39.543615 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.543905 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.544216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.563133 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:39.564395 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.584800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673e78e-f851-4c64-838a-b75b1bb6e9bd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.589412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.590014 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.590290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.590569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.591200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.592821 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.602682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1319/2627] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:39.606853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.616801 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9f5c2-56c1-45f8-9459-a2a677e55beb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.621465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee029a-9415-4fff-bb4d-3b189f315482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.622107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee029a-9415-4fff-bb4d-3b189f315482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.622388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee029a-9415-4fff-bb4d-3b189f315482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.622663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee029a-9415-4fff-bb4d-3b189f315482 admin admin] PATH_INFO: `/v3/projects/33def8e59e9d4ff6adac30260c689032/users/0aa9b52cb5b7486c94c76827c87dd837/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.623515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1309/2628] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:39.624627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee029a-9415-4fff-bb4d-3b189f315482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33def8e59e9d4ff6adac30260c689032, user_id=0aa9b52cb5b7486c94c76827c87dd837, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.627280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee029a-9415-4fff-bb4d-3b189f315482 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.627787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.637540 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32a533-5be3-4ba1-a99d-2452fba0c431 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.638010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1320/2629] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:39 2022] PUT /identity/v3/projects/33def8e59e9d4ff6adac30260c689032/users/0aa9b52cb5b7486c94c76827c87dd837/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:39.648907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.649194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.649472 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.670080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:39.679305 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] MFA Rules not processed for user `0aa9b52cb5b7486c94c76827c87dd837`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:39.680943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.699928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.700566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.700850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.701123 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.701769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:39.702080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.703674 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.715823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1310/2630] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:26:39.719968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.729636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662b11-a252-413a-b0f7-c56d2aef8bf9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.734358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.734957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.735240 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.735633 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.736298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.738203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.757920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1321/2631] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:39.768625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1311/2632] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:39.769902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.771837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:39.773196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.828327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f2f38-bb38-4a0c-92eb-9e8b33c23d6d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.836377 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4619b-4e6c-4349-8f25-91d01ad25a63 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.840918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.841543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.841823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.842092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.842715 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.844740 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.853664 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:39.869794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1312/2633] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:39.870861 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.877508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dfb4f-1c6c-40d5-9917-0b52a4760129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.878117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dfb4f-1c6c-40d5-9917-0b52a4760129 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.878390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dfb4f-1c6c-40d5-9917-0b52a4760129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.878663 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dfb4f-1c6c-40d5-9917-0b52a4760129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.880904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bbe8b-7f72-4f87-b940-8ad224567cbb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.885596 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.886180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.886459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.886731 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.887366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.888966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.899158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1313/2634] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:39.902928 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.913292 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b11a-ffcd-4eb7-8700-ef33e7ab3ee8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.917089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.917673 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.918005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.918379 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.918896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.920500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.932276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1314/2635] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:39.936611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:39.939767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dfb4f-1c6c-40d5-9917-0b52a4760129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.941273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dfb4f-1c6c-40d5-9917-0b52a4760129 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.946396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d84a2-fcf1-4729-aa8c-c42e986bea03 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:39.947018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:39.951561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:39.952229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.952666 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.952781 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1322/2636] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:39.952881 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] PATH_INFO: `/v3/projects/39734a50319048588506dd21a5a428e1/users/669b3515e1d74c81887e47ef6d4a0437/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:39.968727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39734a50319048588506dd21a5a428e1, user_id=669b3515e1d74c81887e47ef6d4a0437, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:39.971416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:39.986261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1315/2637] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:39 2022] PUT /identity/v3/projects/39734a50319048588506dd21a5a428e1/users/669b3515e1d74c81887e47ef6d4a0437/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:39.996756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:39.997079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:39.997381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.027355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] MFA Rules not processed for user `669b3515e1d74c81887e47ef6d4a0437`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:40.027921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.028706 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:40.091571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc2d5-4d6d-4c0c-a62b-a2deda194b0e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.095444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.096072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.096353 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.096661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.098419 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:40.099898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1323/2638] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:40.100607 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.157936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.159418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.164117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28176a-79e4-48fa-ad01-e1242130eebc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.168728 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.169122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1316/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:26:40.169410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.169698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.169971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.170658 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.172624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.199585 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1324/2640] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:40.203553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.217654 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853853-96d7-477a-9d7b-44ac733db762 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.276621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.277263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.277498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.277766 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.278441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.280534 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.289185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:40.304671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1317/2641] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:40.308464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.319786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b76820-3dd7-4c05-af5d-106f31e6d5b0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.324462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.325062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.325342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.325611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.326273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.327870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.339115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1325/2642] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:40.343195 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.353469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef791-3ec9-4256-88b5-e51d559c0028 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.358444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.359075 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.359356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.359628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.360306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.361908 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.372555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1318/2643] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:40.376702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.389122 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cadd1-67be-4949-8874-6058b571347d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.393847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62d586-0743-489b-9083-407bc4ee4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.394502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62d586-0743-489b-9083-407bc4ee4c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.394784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62d586-0743-489b-9083-407bc4ee4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.395057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62d586-0743-489b-9083-407bc4ee4c54 admin admin] PATH_INFO: `/v3/projects/c8564f4cf2ec42d98fb4f7c0561bc8bd/users/ff2b06919cbe4932b996f55e32248c52/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.410228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62d586-0743-489b-9083-407bc4ee4c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8564f4cf2ec42d98fb4f7c0561bc8bd, user_id=ff2b06919cbe4932b996f55e32248c52, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.413334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62d586-0743-489b-9083-407bc4ee4c54 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.427069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1326/2644] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:40 2022] PUT /identity/v3/projects/c8564f4cf2ec42d98fb4f7c0561bc8bd/users/ff2b06919cbe4932b996f55e32248c52/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:40.443196 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.454516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb47be-a362-42f4-8c7c-f6ec6bdecc90 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.494075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.494366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.494643 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.522590 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] MFA Rules not processed for user `ff2b06919cbe4932b996f55e32248c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:40.523733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:40.524869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.525501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.525778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.526046 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] PATH_INFO: `/v3/users/6c7235ac41df44beb0e3aa3d96ed2ffe` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.527153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7235ac41df44beb0e3aa3d96ed2ffe)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.529142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.552281 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:40.576261 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7235ac41df44beb0e3aa3d96ed2ffe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:40.584288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7235ac41df44beb0e3aa3d96ed2ffe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:40.585051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7235ac41df44beb0e3aa3d96ed2ffe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:40.590618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1327/2645] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:40.595021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.597524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7235ac41df44beb0e3aa3d96ed2ffe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:40.605105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fb3df3-4073-442d-abc6-f446a7bd311e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7235ac41df44beb0e3aa3d96ed2ffe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:40.605516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40363f65-47b8-4e20-8ea8-134670e83ab1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.610383 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.610983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.611270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.611536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.612222 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1319/2646] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:40 2022] DELETE /identity/v3/users/6c7235ac41df44beb0e3aa3d96ed2ffe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:40.612332 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.614090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.616324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.616611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.616883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.635743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:40.636977 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:40.645078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1328/2647] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:40.646355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.648531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:40.688174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:40.698889 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1320/2648] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:40.709211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.710556 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:40.716306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327bf6-17b5-423b-8527-36737e5be870 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.720962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.721567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.721850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.722121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.722753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.725266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.752589 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1329/2649] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:40.757150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.766754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3bdc-9813-4a79-bbba-c83343171c69 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.771867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.772495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.772840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.773050 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.773713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.775304 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.778236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93857a62-3d89-49a8-9004-f067b6550cce None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.785301 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1330/2650] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:40.790059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.799399 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871ff5-f1d0-4561-8d26-afe0d10a7d8d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.804088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.804718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.804999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.805273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] PATH_INFO: `/v3/projects/318d7f75631247198c8e6d1842d9847e/users/979592bda7454f4f8ec2bd1453c83ede/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.819580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318d7f75631247198c8e6d1842d9847e, user_id=979592bda7454f4f8ec2bd1453c83ede, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.823052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.828035 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.828661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.828940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.829206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.837033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1331/2651] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:40 2022] PUT /identity/v3/projects/318d7f75631247198c8e6d1842d9847e/users/979592bda7454f4f8ec2bd1453c83ede/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:40.839164 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.840817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.840955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.851434 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1321/2652] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:26:40.905832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181a68-04e4-499c-9937-2cd10685e667 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.911041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695b3c3-b22b-42d3-85d5-9860d71cd9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.912217 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b3c3-b22b-42d3-85d5-9860d71cd9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.912496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b3c3-b22b-42d3-85d5-9860d71cd9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.912767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b3c3-b22b-42d3-85d5-9860d71cd9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.913411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695b3c3-b22b-42d3-85d5-9860d71cd9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.915012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695b3c3-b22b-42d3-85d5-9860d71cd9a8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.917228 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:40.928276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1332/2653] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:26:40.931549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:40.941957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb3b4a-1716-4d28-a3ec-d5fce05cb4fb service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:40.947280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:40.947940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.948251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.948524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] PATH_INFO: `/v3/projects/318d7f75631247198c8e6d1842d9847e/users/979592bda7454f4f8ec2bd1453c83ede/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:40.950602 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=318d7f75631247198c8e6d1842d9847e, user_id=979592bda7454f4f8ec2bd1453c83ede, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:40.953355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:40.964549 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1322/2654] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:40 2022] PUT /identity/v3/projects/318d7f75631247198c8e6d1842d9847e/users/979592bda7454f4f8ec2bd1453c83ede/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:40.975364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:40.975657 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:40.975938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:41.006368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] MFA Rules not processed for user `979592bda7454f4f8ec2bd1453c83ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:41.008218 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:41.079229 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1333/2655] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:41.090723 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:41.092523 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:41.125326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:41.126880 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:41.161575 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab7c3b-9891-4adc-b907-9dcecd997ddd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:41.165469 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:41.166082 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:41.166367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:41.166641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:41.168443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:41.206240 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a2df-5f15-4e81-a5c7-c488046fdcb0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:41.212295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:41.212950 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:41.213239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:41.213519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] PATH_INFO: `/v3/projects/73227eef79834ccfb6231b6a2759dc52` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:41.214898 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73227eef79834ccfb6231b6a2759dc52)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:41.216904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:41.227655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:41.229163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:41.232735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:41.240785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1323/2656] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:41.272123 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73227eef79834ccfb6231b6a2759dc52', 'request_id': 'req-03376ef2-7e79-4f18-9eae-4996274d9161'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.278337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73227eef79834ccfb6231b6a2759dc52', 'request_id': 'req-03376ef2-7e79-4f18-9eae-4996274d9161'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.286180 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73227eef79834ccfb6231b6a2759dc52', 'request_id': 'req-03376ef2-7e79-4f18-9eae-4996274d9161'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.297748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] The token cache is being invalidate because project 73227eef79834ccfb6231b6a2759dc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:41.298027 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.298675 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.300430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1334/2657] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:41 2022] DELETE /identity/v3/projects/73227eef79834ccfb6231b6a2759dc52 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:41.304308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:41.315274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6749f-53e0-4942-9d7b-08327fb10e23 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:41.377011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:41.377955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:41.378242 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:41.378524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] PATH_INFO: `/v3/users/0aa9b52cb5b7486c94c76827c87dd837` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:41.379737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa9b52cb5b7486c94c76827c87dd837)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:41.382344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:41.430037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa9b52cb5b7486c94c76827c87dd837'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.437248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa9b52cb5b7486c94c76827c87dd837'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.437994 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa9b52cb5b7486c94c76827c87dd837'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.452092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa9b52cb5b7486c94c76827c87dd837'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.462017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5fa794c-78f6-42d6-9df0-aa2992a0be23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa9b52cb5b7486c94c76827c87dd837'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.468205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1324/2658] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:41 2022] DELETE /identity/v3/users/0aa9b52cb5b7486c94c76827c87dd837 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:41.744780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:41.746471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:41.760627 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376ef2-7e79-4f18-9eae-4996274d9161 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:41.770255 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:41.823321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:41.824368 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:41.824840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:41.825185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] PATH_INFO: `/v3/projects/33def8e59e9d4ff6adac30260c689032` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:41.826316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33def8e59e9d4ff6adac30260c689032)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:41.828314 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:41.873696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33def8e59e9d4ff6adac30260c689032', 'request_id': 'req-5ec4f0a5-7577-403d-8b94-797309fab64d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.879139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33def8e59e9d4ff6adac30260c689032', 'request_id': 'req-5ec4f0a5-7577-403d-8b94-797309fab64d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.886828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33def8e59e9d4ff6adac30260c689032', 'request_id': 'req-5ec4f0a5-7577-403d-8b94-797309fab64d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.898317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] The token cache is being invalidate because project 33def8e59e9d4ff6adac30260c689032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:41.898600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.899213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5ec4f0a5-7577-403d-8b94-797309fab64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:41.900776 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1335/2659] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:41 2022] DELETE /identity/v3/projects/33def8e59e9d4ff6adac30260c689032 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:41.906612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:41.906885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:41.907159 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:41.926404 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:41.927636 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:41.985311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1325/2660] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:41.993127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:41.993410 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:41.993682 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.013635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:42.014823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:42.023244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1336/2661] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:42.027403 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.037125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2d49-e13e-4980-a3fd-b07212164c7f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.041647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.042241 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.042517 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.042790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.043429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:42.043732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.045366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.056476 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1326/2662] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:42.060645 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.070267 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdd5b-76f8-48b7-b2c7-5daf8beec35d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.074925 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.075435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.075708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.075998 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.076623 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.078503 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.104622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1337/2663] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:42 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:42.108677 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.114967 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:42.118891 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605a31-e55a-461d-990e-258ac858bd86 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.175180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.175831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.176140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.176412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.177562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.179452 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.200224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1327/2664] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:42 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:42.204536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.214876 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bbfd-e014-4fac-96a8-ad91aa71ce91 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.219448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.220079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.220358 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.220626 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.221261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.222875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.232621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1338/2665] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:42.236425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.246509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0778-7fc9-4bc7-8a91-cdff19b9c4e2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.251146 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47f725-401e-44ff-8bdf-5856d00c98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.251786 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47f725-401e-44ff-8bdf-5856d00c98b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.252121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47f725-401e-44ff-8bdf-5856d00c98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.252402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47f725-401e-44ff-8bdf-5856d00c98b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.253047 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47f725-401e-44ff-8bdf-5856d00c98b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.254691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47f725-401e-44ff-8bdf-5856d00c98b9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.265791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1328/2666] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:42.269794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.279622 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a6043-bc1d-4ffd-8b08-7718b77e5e11 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.284249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.284887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.285163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.285686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] PATH_INFO: `/v3/projects/453f56f86b67483fab03e2c45746519c/users/bf5dda23e1af4f01b1ba16090742b0ee/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.299594 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453f56f86b67483fab03e2c45746519c, user_id=bf5dda23e1af4f01b1ba16090742b0ee, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.302770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.315135 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1339/2667] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:42 2022] PUT /identity/v3/projects/453f56f86b67483fab03e2c45746519c/users/bf5dda23e1af4f01b1ba16090742b0ee/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:42.326637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.326865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.327135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.353246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] MFA Rules not processed for user `bf5dda23e1af4f01b1ba16090742b0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:42.354444 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:42.415492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1329/2668] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:42.427303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.429023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:42.472532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:42.487904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a87f6b-d453-40ed-9f8d-cdf2b17dcc29 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.492303 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.492912 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.493187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.493453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.503650 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.507726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.524170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1340/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:42.777689 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:42.789011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef6a15-2ac5-4af7-864a-aa1d9ef4dc3c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:42.792849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:42.793541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:42.793820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:42.794122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:42.796508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:42.858691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:42.860411 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:42.871697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1330/2670] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:43.385603 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:43.394193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0df237-e3fb-4130-bacb-77a996535067 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:43.398379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:43.398966 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:43.399245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:43.399515 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:43.401203 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:43.462713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:43.464189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09179d-5838-4b72-b672-7882ccd57ca2 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:43.473551 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1341/2671] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:47.320233 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:47.321806 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:47.336947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:47.391217 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b179e-f3c2-4efb-9a5f-e2197d4d8a1f service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:47.395682 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:47.396613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:47.396900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:47.397175 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] PATH_INFO: `/v3/users/669b3515e1d74c81887e47ef6d4a0437` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:47.398309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669b3515e1d74c81887e47ef6d4a0437)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:47.400280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:47.455166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669b3515e1d74c81887e47ef6d4a0437'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:47.466697 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669b3515e1d74c81887e47ef6d4a0437'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:47.467262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669b3515e1d74c81887e47ef6d4a0437'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:47.480932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669b3515e1d74c81887e47ef6d4a0437'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:47.491089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669b3515e1d74c81887e47ef6d4a0437'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:47.497442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1331/2672] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:47 2022] DELETE /identity/v3/users/669b3515e1d74c81887e47ef6d4a0437 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:47.501753 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:47.502225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:47.502321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:47.521539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:47.522759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:47.585616 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1342/2673] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:47.595824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:47.597328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:47.656184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6e10-c16d-4bb3-94af-07231fc77342 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:47.660210 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:47.661136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:47.661487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:47.661825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:47.671779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:47.673283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:47.683610 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1332/2674] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:48.009655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:48.011328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:48.024134 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd030-3ec0-4b24-8ebc-1985b5b8172b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:48.028780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:48.029430 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:48.029699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:48.029975 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] PATH_INFO: `/v3/projects/39734a50319048588506dd21a5a428e1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:48.031115 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39734a50319048588506dd21a5a428e1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:48.033108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:48.081798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39734a50319048588506dd21a5a428e1', 'request_id': 'req-e527f2f8-e16a-4689-b8fc-1c278145ec64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.087878 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39734a50319048588506dd21a5a428e1', 'request_id': 'req-e527f2f8-e16a-4689-b8fc-1c278145ec64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.095577 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39734a50319048588506dd21a5a428e1', 'request_id': 'req-e527f2f8-e16a-4689-b8fc-1c278145ec64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.103243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:48.109924 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] The token cache is being invalidate because project 39734a50319048588506dd21a5a428e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:48.110231 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.111337 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.113354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1343/2675] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:48 2022] DELETE /identity/v3/projects/39734a50319048588506dd21a5a428e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:48.117841 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:48.128413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1db4b-00a0-44eb-aaee-d94f21e5946b service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:48.158380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:48.189813 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:48.190457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:48.190735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:48.191005 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] PATH_INFO: `/v3/users/ff2b06919cbe4932b996f55e32248c52` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:48.192232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2b06919cbe4932b996f55e32248c52)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:48.194243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:48.239295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2b06919cbe4932b996f55e32248c52'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.246559 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2b06919cbe4932b996f55e32248c52'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.247248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2b06919cbe4932b996f55e32248c52'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.258950 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2b06919cbe4932b996f55e32248c52'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.265760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2b06919cbe4932b996f55e32248c52'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.271866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1333/2676] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:48 2022] DELETE /identity/v3/users/ff2b06919cbe4932b996f55e32248c52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:48.555923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:48.557378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:48.570911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f2f8-e16a-4689-b8fc-1c278145ec64 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:48.631865 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:48.632519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:48.632793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:48.633059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] PATH_INFO: `/v3/projects/c8564f4cf2ec42d98fb4f7c0561bc8bd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:48.634269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8564f4cf2ec42d98fb4f7c0561bc8bd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:48.636268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:48.682116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8564f4cf2ec42d98fb4f7c0561bc8bd', 'request_id': 'req-171bd967-75e8-409f-83e8-882a579fc483'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.687444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8564f4cf2ec42d98fb4f7c0561bc8bd', 'request_id': 'req-171bd967-75e8-409f-83e8-882a579fc483'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.699911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8564f4cf2ec42d98fb4f7c0561bc8bd', 'request_id': 'req-171bd967-75e8-409f-83e8-882a579fc483'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.711121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] The token cache is being invalidate because project c8564f4cf2ec42d98fb4f7c0561bc8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:48.711408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.712087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.713568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1344/2677] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:48 2022] DELETE /identity/v3/projects/c8564f4cf2ec42d98fb4f7c0561bc8bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:48.717941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:48.719447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:48.732105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19909-0c79-494c-ba34-8dc8b3da8ee2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:48.791283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:48.791913 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:48.792235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:48.792510 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] PATH_INFO: `/v3/users/979592bda7454f4f8ec2bd1453c83ede` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:48.793624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979592bda7454f4f8ec2bd1453c83ede)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:48.795589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:48.843624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979592bda7454f4f8ec2bd1453c83ede'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.849198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:48.851634 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979592bda7454f4f8ec2bd1453c83ede'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.852415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979592bda7454f4f8ec2bd1453c83ede'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.867699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979592bda7454f4f8ec2bd1453c83ede'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.874885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b5fc5cc-6c39-4dd1-8663-5e30f3ce0a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979592bda7454f4f8ec2bd1453c83ede'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:48.881684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1334/2678] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:48 2022] DELETE /identity/v3/users/979592bda7454f4f8ec2bd1453c83ede => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:49.172831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.174288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:49.187941 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd967-75e8-409f-83e8-882a579fc483 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.247046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.247680 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.247943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.248236 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] PATH_INFO: `/v3/projects/318d7f75631247198c8e6d1842d9847e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.249350 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318d7f75631247198c8e6d1842d9847e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.251471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.285606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:49.302212 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318d7f75631247198c8e6d1842d9847e', 'request_id': 'req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:49.308725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318d7f75631247198c8e6d1842d9847e', 'request_id': 'req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:49.316846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318d7f75631247198c8e6d1842d9847e', 'request_id': 'req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:49.330560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] The token cache is being invalidate because project 318d7f75631247198c8e6d1842d9847e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:49.330845 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:49.331481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59ce6b6e-0c26-499d-bb4e-70fb146f9f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:49.332995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1345/2679] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:49 2022] DELETE /identity/v3/projects/318d7f75631247198c8e6d1842d9847e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:26:49.338340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.338628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.338906 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.357945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:49.359158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:49.420997 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1335/2680] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:49.429413 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.429701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.429976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.450120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:49.451395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:49.459377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1346/2681] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:49.463661 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.473347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3afb-cbb6-49e6-91f7-db5ffda1bc4a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.478418 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.479105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.479385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.479655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.480337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:49.480646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.482260 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.494459 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1336/2682] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:49.498769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.508799 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a29a7-b667-464a-9f1d-22f71fb569e7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.513477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.514077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.514357 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.514661 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.515283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.517342 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.544591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1347/2683] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:49.548803 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.559271 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb681-9e47-4591-b398-c57860e830fe admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.618134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.619026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.619448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.619877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.620855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.622787 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.646410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1337/2684] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:49 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:49.650498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.662436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51c70f-8339-4e2d-918e-9ce7d637bb9d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.667089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.667687 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.667977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.668266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.668940 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.670558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.681573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1348/2685] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:49.685487 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.695854 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d605-f0c6-4a6e-8ab2-27f79e0fdbe9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.700508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c108b0-ffc6-48c9-807e-eb9230b7b7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.701100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c108b0-ffc6-48c9-807e-eb9230b7b7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.701543 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c108b0-ffc6-48c9-807e-eb9230b7b7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.701765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c108b0-ffc6-48c9-807e-eb9230b7b7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.702402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c108b0-ffc6-48c9-807e-eb9230b7b7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.704011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c108b0-ffc6-48c9-807e-eb9230b7b7ef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.714764 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1338/2686] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:49.718854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.729553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b199c7-061c-48fb-95c5-0ae0e7e905a1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.734417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.735081 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.735360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.735635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] PATH_INFO: `/v3/projects/d9444d55080d404b8b6a1d017151500c/users/d0f147288bad4e1fa2e689ceee570c25/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.751367 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9444d55080d404b8b6a1d017151500c, user_id=d0f147288bad4e1fa2e689ceee570c25, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.754107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.767711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1349/2687] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:49 2022] PUT /identity/v3/projects/d9444d55080d404b8b6a1d017151500c/users/d0f147288bad4e1fa2e689ceee570c25/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:49.779709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.780235 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.780357 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.809101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] MFA Rules not processed for user `d0f147288bad4e1fa2e689ceee570c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:49.810322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:49.835982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:49.876798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1339/2688] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:49.888259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:49.889978 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:49.948007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5096d-06d2-42c6-a2e5-44415ed6b1fc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:49.951794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef4d6b-6afe-475e-a220-3d71271c4aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:49.952378 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4d6b-6afe-475e-a220-3d71271c4aac service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:49.952666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4d6b-6afe-475e-a220-3d71271c4aac service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:49.952939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4d6b-6afe-475e-a220-3d71271c4aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:49.961470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef4d6b-6afe-475e-a220-3d71271c4aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:49.962917 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef4d6b-6afe-475e-a220-3d71271c4aac service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:49.971793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1350/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:52.549711 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:52.615978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ce7f-feab-4721-a45c-7c80a7021b1b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:52.620466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:52.621109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:52.621392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:52.621668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] PATH_INFO: `/v3/users/d0f147288bad4e1fa2e689ceee570c25` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:52.622791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f147288bad4e1fa2e689ceee570c25)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:52.624820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:52.672962 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f147288bad4e1fa2e689ceee570c25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:52.679721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f147288bad4e1fa2e689ceee570c25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:52.680417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f147288bad4e1fa2e689ceee570c25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:52.691839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f147288bad4e1fa2e689ceee570c25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:52.700688 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f147288bad4e1fa2e689ceee570c25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:52.706423 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1340/2690] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:52 2022] DELETE /identity/v3/users/d0f147288bad4e1fa2e689ceee570c25 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:52.711483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:52.712082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:52.712082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:52.730655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:52.731883 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:52.783433 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:52.793591 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1351/2691] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:52.802941 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:52.804521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:52.857607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:52.862930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3bac6-adc3-4a54-b35c-55050c050a96 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:52.867864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:52.868624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:52.868902 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:52.869442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:52.879121 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:52.881145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:52.890996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1341/2692] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:53.187588 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:53.189729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:53.204550 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff03aa-1ce1-4884-a9f7-1ef3dda23dab None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:53.210080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:53.210735 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:53.211012 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:53.211327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] PATH_INFO: `/v3/projects/d9444d55080d404b8b6a1d017151500c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:53.213090 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9444d55080d404b8b6a1d017151500c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:53.215259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:53.262364 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9444d55080d404b8b6a1d017151500c', 'request_id': 'req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:53.268838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9444d55080d404b8b6a1d017151500c', 'request_id': 'req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:53.277091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9444d55080d404b8b6a1d017151500c', 'request_id': 'req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:53.291637 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] The token cache is being invalidate because project d9444d55080d404b8b6a1d017151500c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:53.291856 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:53.292595 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d7023d4-be8c-4a3b-b2a6-bcd268c5fe85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:53.294080 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1352/2693] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:53 2022] DELETE /identity/v3/projects/d9444d55080d404b8b6a1d017151500c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:54.169782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:54.171215 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:54.184541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe708ec-410c-44b2-9915-1d1a39c23154 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:54.240801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:54.241432 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:54.241714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:54.241985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] PATH_INFO: `/v3/users/bf5dda23e1af4f01b1ba16090742b0ee` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:54.243125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5dda23e1af4f01b1ba16090742b0ee)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:54.245129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:54.292115 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5dda23e1af4f01b1ba16090742b0ee'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.299174 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5dda23e1af4f01b1ba16090742b0ee'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.299784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5dda23e1af4f01b1ba16090742b0ee'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.313603 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5dda23e1af4f01b1ba16090742b0ee'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.321351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5dda23e1af4f01b1ba16090742b0ee'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.328606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1342/2694] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:54 2022] DELETE /identity/v3/users/bf5dda23e1af4f01b1ba16090742b0ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:54.333215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bca349-c8da-4710-a358-5c85036057de None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:54.333672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bca349-c8da-4710-a358-5c85036057de None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:54.333814 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bca349-c8da-4710-a358-5c85036057de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:54.353921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-96bca349-c8da-4710-a358-5c85036057de None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:54.355140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96bca349-c8da-4710-a358-5c85036057de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:54.413133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1353/2695] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:54.422954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:54.424345 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:54.479851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc462-46c4-4b68-8ec5-650b501719a2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:54.483450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cb9be-1b2a-4c6e-845a-b29f14441816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:54.484078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cb9be-1b2a-4c6e-845a-b29f14441816 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:54.484358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cb9be-1b2a-4c6e-845a-b29f14441816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:54.484624 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cb9be-1b2a-4c6e-845a-b29f14441816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:54.493772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cb9be-1b2a-4c6e-845a-b29f14441816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:54.495192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cb9be-1b2a-4c6e-845a-b29f14441816 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:54.504312 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1343/2696] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:54.771900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bca349-c8da-4710-a358-5c85036057de None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:54.773384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96bca349-c8da-4710-a358-5c85036057de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:54.788465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bca349-c8da-4710-a358-5c85036057de None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:54.793133 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:54.793770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:54.794051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:54.794328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] PATH_INFO: `/v3/projects/453f56f86b67483fab03e2c45746519c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:54.795450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=453f56f86b67483fab03e2c45746519c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:54.797425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:54.843334 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453f56f86b67483fab03e2c45746519c', 'request_id': 'req-517df9f9-1aff-41cc-84ff-6fbad854d79d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.848639 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453f56f86b67483fab03e2c45746519c', 'request_id': 'req-517df9f9-1aff-41cc-84ff-6fbad854d79d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.856445 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453f56f86b67483fab03e2c45746519c', 'request_id': 'req-517df9f9-1aff-41cc-84ff-6fbad854d79d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.867306 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] The token cache is being invalidate because project 453f56f86b67483fab03e2c45746519c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:54.867860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.868518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-517df9f9-1aff-41cc-84ff-6fbad854d79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:54.869972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1354/2697] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:54 2022] DELETE /identity/v3/projects/453f56f86b67483fab03e2c45746519c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:54.875069 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:54.875356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:54.875631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:54.894408 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:54.895703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:54.901460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:54.955262 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1344/2698] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:54.963382 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:54.963671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:54.963949 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:54.978344 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:54.984183 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:54.985839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:54.994239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1355/2699] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:54.998537 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.008631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf5b6e-8cd5-4c1f-9c06-802c2c9cfaa8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.013078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.013668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.013947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.014219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.014858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:55.015157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.016784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.028429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1345/2700] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 14:26:55.032353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.041806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e33d8-7b45-45cd-aa60-2197ab3f4dd3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.046404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.046999 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.047279 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.047553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.048219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.050181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.078600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1356/2701] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:55 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:55.082752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.093239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb701-7c08-4316-94b2-413bde22650d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.149263 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.149862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.150140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.150410 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.151018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.152966 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.173439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1346/2702] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:55 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:55.177522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.187936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5acb-a81d-4a0c-ac93-4d2a0274ee93 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.193196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.193807 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.194088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.194390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.195038 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.196688 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.206474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1357/2703] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:55.210694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.220470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315cb69-0b91-47fd-b5ee-7b9f177861cf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.225078 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e3030-482a-407b-8b43-a95fc1257695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.225675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3030-482a-407b-8b43-a95fc1257695 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.225963 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3030-482a-407b-8b43-a95fc1257695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.226239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3030-482a-407b-8b43-a95fc1257695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.226882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e3030-482a-407b-8b43-a95fc1257695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.228555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e3030-482a-407b-8b43-a95fc1257695 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.238831 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1347/2704] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:55.242713 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.252451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb46eb-4b8b-4334-bdba-3dabbbd5739e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.257543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.258185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.258464 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.258736 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] PATH_INFO: `/v3/projects/db6aa5b4a7ca4f3594d4993f42214b46/users/e563219c653d4806b9fb34fcec93fee3/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.273239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6aa5b4a7ca4f3594d4993f42214b46, user_id=e563219c653d4806b9fb34fcec93fee3, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.275886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.288803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1358/2705] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:55 2022] PUT /identity/v3/projects/db6aa5b4a7ca4f3594d4993f42214b46/users/e563219c653d4806b9fb34fcec93fee3/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:55.299830 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.300153 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.300431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.328850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] MFA Rules not processed for user `e563219c653d4806b9fb34fcec93fee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:55.330068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:55.393356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1348/2706] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:26:55.404157 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:55.405870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:55.462879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72e62-e0f2-4639-8fd8-307c5bece186 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:55.466604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490d3dc-303c-47ea-9c9c-386a550af875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:55.467250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d3dc-303c-47ea-9c9c-386a550af875 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:55.467536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d3dc-303c-47ea-9c9c-386a550af875 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:55.467815 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d3dc-303c-47ea-9c9c-386a550af875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:55.476291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490d3dc-303c-47ea-9c9c-386a550af875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:55.477759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490d3dc-303c-47ea-9c9c-386a550af875 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:55.486522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1359/2707] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:58.478835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:58.487361 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:58.541717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a522f-d359-4bcd-8130-97e95f25c29d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:58.546126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:58.546746 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:58.547021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:58.547298 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] PATH_INFO: `/v3/users/e563219c653d4806b9fb34fcec93fee3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:58.548421 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e563219c653d4806b9fb34fcec93fee3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:58.550338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:58.716878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e563219c653d4806b9fb34fcec93fee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:58.723354 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e563219c653d4806b9fb34fcec93fee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:58.724071 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e563219c653d4806b9fb34fcec93fee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:58.736148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e563219c653d4806b9fb34fcec93fee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:58.744569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e563219c653d4806b9fb34fcec93fee3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:58.750412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1349/2708] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:26:58 2022] DELETE /identity/v3/users/e563219c653d4806b9fb34fcec93fee3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:58.754892 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:58.755901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:58.756028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:58.775537 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:58.776830 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:58.834567 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1360/2709] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:58.844154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:58.845538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:58.900937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e221b-6b0d-4d29-9a51-7528326c941c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:58.904554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed1e88-1d2c-468a-9c12-edcf8239cf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:58.905150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed1e88-1d2c-468a-9c12-edcf8239cf23 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:58.905426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed1e88-1d2c-468a-9c12-edcf8239cf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:58.905691 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed1e88-1d2c-468a-9c12-edcf8239cf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:58.914737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed1e88-1d2c-468a-9c12-edcf8239cf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:58.916131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed1e88-1d2c-468a-9c12-edcf8239cf23 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:58.925266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1350/2710] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:26:59.190284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.191745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:59.204574 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147ae5-f730-4678-b947-900043d11a99 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.209291 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.209967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.210359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.210549 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] PATH_INFO: `/v3/projects/db6aa5b4a7ca4f3594d4993f42214b46` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.211690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6aa5b4a7ca4f3594d4993f42214b46)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.213676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.254705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:59.262388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6aa5b4a7ca4f3594d4993f42214b46', 'request_id': 'req-dfc4b5da-7af4-460b-869a-509ebaf510f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:59.268020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6aa5b4a7ca4f3594d4993f42214b46', 'request_id': 'req-dfc4b5da-7af4-460b-869a-509ebaf510f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:59.275516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6aa5b4a7ca4f3594d4993f42214b46', 'request_id': 'req-dfc4b5da-7af4-460b-869a-509ebaf510f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:59.286689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] The token cache is being invalidate because project db6aa5b4a7ca4f3594d4993f42214b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:26:59.286979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:59.287600 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dfc4b5da-7af4-460b-869a-509ebaf510f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:26:59.289118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1361/2711] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:26:59 2022] DELETE /identity/v3/projects/db6aa5b4a7ca4f3594d4993f42214b46 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:59.294061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.294343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.294613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.313593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:59.314824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:59.338334 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:59.373321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1351/2712] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:59.381429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.381715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.381987 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.401716 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:59.402904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:59.411251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1362/2713] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:59.415439 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.425148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc2456-4518-47c1-af57-256eb164e610 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.430246 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.430844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.431125 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.431398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.432089 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:26:59.432398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.433998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.445988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1352/2714] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:26:59.450126 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.459259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e6aa9-6166-46da-9944-da916adb528f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.463979 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.464587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.464885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.465150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.465786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.467681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.494980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1363/2715] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:59.499101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.508948 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4508ec-a0eb-42c7-82b2-6d084828e6df admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.563696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.564355 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.564631 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.564899 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.565528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.567416 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.587437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1353/2716] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:26:59.591501 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.602166 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f628-246c-470d-bc47-cf87fe32b4c7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.606689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.607284 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.607563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.607834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.608514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.610113 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.619921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1364/2717] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:59.623611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.633753 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d4e8-f200-4568-aba8-565c39bc6fe2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.638251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750c19-af8e-46ad-bd0b-709238aad6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.638839 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750c19-af8e-46ad-bd0b-709238aad6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.639119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750c19-af8e-46ad-bd0b-709238aad6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.639391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750c19-af8e-46ad-bd0b-709238aad6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.640060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750c19-af8e-46ad-bd0b-709238aad6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.641639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750c19-af8e-46ad-bd0b-709238aad6aa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.651949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1354/2718] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:26:59.655936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.666185 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba0e6-24e4-4154-b6de-0c5c8e2c220a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.670809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.671451 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.671732 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.672040 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] PATH_INFO: `/v3/projects/69562935fc4d4885a2a4a8c197e67189/users/401b7bd4e5a44f5f86162175f100f732/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.686246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69562935fc4d4885a2a4a8c197e67189, user_id=401b7bd4e5a44f5f86162175f100f732, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.688943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.701768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1365/2719] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:26:59 2022] PUT /identity/v3/projects/69562935fc4d4885a2a4a8c197e67189/users/401b7bd4e5a44f5f86162175f100f732/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:26:59.712579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.712866 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.713138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.740030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] MFA Rules not processed for user `401b7bd4e5a44f5f86162175f100f732`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:26:59.741239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:26:59.805029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1355/2720] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:26:59.809554 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.871559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d22b2e-082b-4154-a4ed-557a395b3ad9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.876216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.876819 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.877125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.877400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.878026 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.879945 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:26:59.906449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1366/2721] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:26:59.910844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:26:59.921397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ad450-3b69-400e-ba7a-483336b5b5a9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:26:59.941150 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:59.977604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:26:59.978224 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:26:59.978500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:26:59.978769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:26:59.979376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:26:59.981412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.001316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1356/2722] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:26:59 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:27:00.005977 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.016419 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbe352-04b0-49a5-acc5-9d23a7f59857 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.021059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.021655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.021936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.022208 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.022847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.024507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.036174 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1367/2723] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:00.039845 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.049541 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2b9b-abdc-447d-88c5-e7464786f3d6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.055158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dedad-e2e3-4412-a255-6868e541449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.055720 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dedad-e2e3-4412-a255-6868e541449d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.056033 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dedad-e2e3-4412-a255-6868e541449d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.056337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dedad-e2e3-4412-a255-6868e541449d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.056978 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dedad-e2e3-4412-a255-6868e541449d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.058558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dedad-e2e3-4412-a255-6868e541449d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.068838 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1357/2724] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:00.072963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.082906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea47aaf-7c83-4145-ad16-a30675603fbd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.087498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.088177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.088453 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.088725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] PATH_INFO: `/v3/projects/6ec738e0c1fc4f5bae90f04d09f22d0e/users/8cdb346f333048398703a1c5e530eb73/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.102886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec738e0c1fc4f5bae90f04d09f22d0e, user_id=8cdb346f333048398703a1c5e530eb73, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.105561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.118327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1368/2725] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:27:00 2022] PUT /identity/v3/projects/6ec738e0c1fc4f5bae90f04d09f22d0e/users/8cdb346f333048398703a1c5e530eb73/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:00.182903 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.183201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.183471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.210944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] MFA Rules not processed for user `8cdb346f333048398703a1c5e530eb73`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:00.212180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:00.273254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1358/2726] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:00.277846 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.295612 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:00.341137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723696ab-d280-4827-a899-01bf5941901a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.345820 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.346448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.346794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.347093 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.347703 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.350193 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.376096 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1369/2727] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:27:00 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:27:00.380135 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.390576 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd801c86-57fd-412e-ae02-301b76972747 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.447739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.448392 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.448671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.448952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.449579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.451516 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.473342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1359/2728] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:27:00 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:27:00.477929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.488461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f7597-62d0-4296-b6e1-8c4ae56d029c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.493733 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.494340 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.494624 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.494896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.495541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.497191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.508117 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1370/2729] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:00.512524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.522791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d126e-95b8-42c2-b0aa-840be9e06c7e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.527360 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.528070 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.528351 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.528622 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] PATH_INFO: `/v3/projects/416cc0960d2a49e7a5ebebee9421b955/users/6c5766c89a0a4e2ba8befb41737b277a/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.543883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416cc0960d2a49e7a5ebebee9421b955, user_id=6c5766c89a0a4e2ba8befb41737b277a, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.546588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.555026 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:00.561493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1360/2730] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:27:00 2022] PUT /identity/v3/projects/416cc0960d2a49e7a5ebebee9421b955/users/6c5766c89a0a4e2ba8befb41737b277a/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:00.565481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.575698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983484e-4c45-4c5c-91bd-4bb27b3009ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.631726 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295cc5d-1533-45ff-a64f-af5ec160ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.632287 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295cc5d-1533-45ff-a64f-af5ec160ee86 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.632565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295cc5d-1533-45ff-a64f-af5ec160ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.632834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295cc5d-1533-45ff-a64f-af5ec160ee86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.633473 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295cc5d-1533-45ff-a64f-af5ec160ee86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.635065 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295cc5d-1533-45ff-a64f-af5ec160ee86 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.644793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1371/2731] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:00.649643 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.659550 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feaf740-fb93-4083-b4b6-c171e471bfc6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.665042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.665712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.665985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.666253 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] PATH_INFO: `/v3/projects/416cc0960d2a49e7a5ebebee9421b955/users/6c5766c89a0a4e2ba8befb41737b277a/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.668223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416cc0960d2a49e7a5ebebee9421b955, user_id=6c5766c89a0a4e2ba8befb41737b277a, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.670856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.680542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1361/2732] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:27:00 2022] PUT /identity/v3/projects/416cc0960d2a49e7a5ebebee9421b955/users/6c5766c89a0a4e2ba8befb41737b277a/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:00.690668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.690976 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.691251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.718225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] MFA Rules not processed for user `6c5766c89a0a4e2ba8befb41737b277a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:00.719422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:00.787161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1372/2733] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:00.798454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:00.800142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:00.856699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb405d5-e8e3-46ab-8658-5e5fe2bdeb55 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:00.860285 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:00.860879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:00.861157 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:00.861429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:00.915310 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:00.916699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:00.925226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1362/2734] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:02.412576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:02.413962 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:02.425858 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b67f7-a07e-4ab3-858f-04356e1ffe6e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:02.429421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:02.430019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:02.430299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:02.430569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:02.438919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:02.489001 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:02.490422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:02.499692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1373/2735] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:03.011180 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:03.020131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd7c6-1ead-4291-8918-140abf838067 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:03.024324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1108e-e0f0-4e35-917a-a7e5fcbf5a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:03.024927 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1108e-e0f0-4e35-917a-a7e5fcbf5a5b service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:03.025203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1108e-e0f0-4e35-917a-a7e5fcbf5a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:03.025473 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1108e-e0f0-4e35-917a-a7e5fcbf5a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:03.034181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1108e-e0f0-4e35-917a-a7e5fcbf5a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:03.035885 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1108e-e0f0-4e35-917a-a7e5fcbf5a5b service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:03.045600 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1363/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:06.895709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:06.957426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c08711-573d-4084-9486-43df59242586 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:06.962804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:06.963429 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:06.963708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:06.964003 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] PATH_INFO: `/v3/users/401b7bd4e5a44f5f86162175f100f732` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:06.965116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=401b7bd4e5a44f5f86162175f100f732)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:06.967046 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:07.010609 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401b7bd4e5a44f5f86162175f100f732'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.011177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401b7bd4e5a44f5f86162175f100f732'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.011796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401b7bd4e5a44f5f86162175f100f732'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.024138 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401b7bd4e5a44f5f86162175f100f732'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.030960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401b7bd4e5a44f5f86162175f100f732'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.045547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1374/2737] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:06 2022] DELETE /identity/v3/users/401b7bd4e5a44f5f86162175f100f732 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:07.050044 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:07.050500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:07.050611 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:07.069192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:07.070368 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:07.127660 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1364/2738] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:07.137385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:07.138834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:07.171057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:07.198444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e353-52c0-40ac-bcd5-7a8a4c359f6e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:07.202207 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:07.202818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:07.203101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:07.203386 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:07.212525 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:07.213957 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:07.223369 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1375/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:07.496850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:07.498291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:07.510190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960256c-d94e-484e-9df9-dd04ec38b95c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:07.514701 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:07.515335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:07.515616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:07.515893 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] PATH_INFO: `/v3/projects/69562935fc4d4885a2a4a8c197e67189` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:07.517088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69562935fc4d4885a2a4a8c197e67189)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:07.518998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:07.542949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:07.566412 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69562935fc4d4885a2a4a8c197e67189', 'request_id': 'req-6615ebe9-943f-4b72-836e-efce2ffe8a1c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.571974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69562935fc4d4885a2a4a8c197e67189', 'request_id': 'req-6615ebe9-943f-4b72-836e-efce2ffe8a1c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.578446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69562935fc4d4885a2a4a8c197e67189', 'request_id': 'req-6615ebe9-943f-4b72-836e-efce2ffe8a1c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.590232 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] The token cache is being invalidate because project 69562935fc4d4885a2a4a8c197e67189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:07.590563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.591223 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.592750 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1365/2740] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:07 2022] DELETE /identity/v3/projects/69562935fc4d4885a2a4a8c197e67189 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:07.596719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:07.607162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b56b6-d55f-40be-bf48-acc671be39e3 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:07.662556 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:07.663518 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:07.663842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:07.664264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] PATH_INFO: `/v3/users/8cdb346f333048398703a1c5e530eb73` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:07.665377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdb346f333048398703a1c5e530eb73)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:07.667322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:07.713020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdb346f333048398703a1c5e530eb73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.713653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdb346f333048398703a1c5e530eb73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.714270 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdb346f333048398703a1c5e530eb73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.725759 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdb346f333048398703a1c5e530eb73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.734843 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdb346f333048398703a1c5e530eb73'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:07.748967 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1376/2741] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:07 2022] DELETE /identity/v3/users/8cdb346f333048398703a1c5e530eb73 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:08.024505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:08.025965 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:08.041738 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615ebe9-943f-4b72-836e-efce2ffe8a1c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:08.102531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:08.103165 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.103426 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.103694 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] PATH_INFO: `/v3/projects/6ec738e0c1fc4f5bae90f04d09f22d0e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.104824 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec738e0c1fc4f5bae90f04d09f22d0e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:08.107162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:08.155773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec738e0c1fc4f5bae90f04d09f22d0e', 'request_id': 'req-66c0211b-823b-41f6-b83a-5ffe2722facf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.162877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec738e0c1fc4f5bae90f04d09f22d0e', 'request_id': 'req-66c0211b-823b-41f6-b83a-5ffe2722facf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.170314 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec738e0c1fc4f5bae90f04d09f22d0e', 'request_id': 'req-66c0211b-823b-41f6-b83a-5ffe2722facf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.182782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] The token cache is being invalidate because project 6ec738e0c1fc4f5bae90f04d09f22d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:08.183093 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.183698 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.188283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1366/2742] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:08 2022] DELETE /identity/v3/projects/6ec738e0c1fc4f5bae90f04d09f22d0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:08.189717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:08.191544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:08.206116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df7958-1884-4597-b69b-45c0fd9c6ad5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:08.259170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:08.271809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:08.272529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.272813 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.273087 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] PATH_INFO: `/v3/users/6c5766c89a0a4e2ba8befb41737b277a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.274474 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5766c89a0a4e2ba8befb41737b277a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:08.276443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:08.325847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5766c89a0a4e2ba8befb41737b277a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.326602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5766c89a0a4e2ba8befb41737b277a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.327271 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5766c89a0a4e2ba8befb41737b277a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.339017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5766c89a0a4e2ba8befb41737b277a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.345707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bbf54e7-dd36-436e-9655-c3fe667deb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5766c89a0a4e2ba8befb41737b277a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.359490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1377/2743] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:08 2022] DELETE /identity/v3/users/6c5766c89a0a4e2ba8befb41737b277a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:08.639940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:08.641375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:08.655051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0211b-823b-41f6-b83a-5ffe2722facf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:08.695874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:08.715732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:08.716396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.716675 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.716945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] PATH_INFO: `/v3/projects/416cc0960d2a49e7a5ebebee9421b955` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.718039 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=416cc0960d2a49e7a5ebebee9421b955)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:08.719944 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:08.766158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416cc0960d2a49e7a5ebebee9421b955', 'request_id': 'req-002d4526-11dd-4282-93e8-32a3c43dd72e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.772138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416cc0960d2a49e7a5ebebee9421b955', 'request_id': 'req-002d4526-11dd-4282-93e8-32a3c43dd72e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.779525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416cc0960d2a49e7a5ebebee9421b955', 'request_id': 'req-002d4526-11dd-4282-93e8-32a3c43dd72e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.791589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] The token cache is being invalidate because project 416cc0960d2a49e7a5ebebee9421b955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:08.791877 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.792546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-002d4526-11dd-4282-93e8-32a3c43dd72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:08.794022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1367/2744] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:08 2022] DELETE /identity/v3/projects/416cc0960d2a49e7a5ebebee9421b955 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:08.798885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.799168 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.799438 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.818602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:08.819812 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:08.877439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1378/2745] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:08.886366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.886591 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.886869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.907244 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:08.908484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:08.917185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1368/2746] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:08.921509 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:08.931196 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb5a87-a61d-45d3-b81b-2544b916b911 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:08.935754 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:08.936398 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.936683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.936958 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.937605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:27:08.937911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:08.939514 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:08.951000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1379/2747] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:27:08.955132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:08.964768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fcf70-381d-47d7-b5ba-ce3002ae129d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:08.969326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:08.969910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:08.970187 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:08.970477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:08.971087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:08.973022 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:08.999663 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1369/2748] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:27:08 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 14:27:09.003853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:09.013948 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfff7d-25c9-42bd-b31a-ed2c20737b71 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:09.064774 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:09.072875 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:09.073597 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:09.074099 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:09.074520 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:09.075199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:09.077310 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:09.097749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1380/2749] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:27:09 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:27:09.101992 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:09.112168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c5299-b301-4cfc-9504-0bc68b4c79a3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:09.117184 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:09.117778 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:09.118058 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:09.118326 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:09.118988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:09.120609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:09.130958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1370/2750] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:09.135051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:09.145199 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35cea7-1cff-4a67-82c9-1a87a8e645f2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:09.149780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dc35f-3d5a-4801-81ab-fff2f5c89103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:09.150372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc35f-3d5a-4801-81ab-fff2f5c89103 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:09.150651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc35f-3d5a-4801-81ab-fff2f5c89103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:09.150920 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc35f-3d5a-4801-81ab-fff2f5c89103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:09.151563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dc35f-3d5a-4801-81ab-fff2f5c89103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:09.153179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dc35f-3d5a-4801-81ab-fff2f5c89103 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:09.164353 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1381/2751] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:09.168309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:09.178669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79107956-6e73-44f3-9317-97b70bfd425a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:09.183324 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:09.184028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:09.184301 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:09.184657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] PATH_INFO: `/v3/projects/5f4cc685632d48239904ee7af7a553ae/users/17cbbd39accd405487d0eb02fc9a1b4d/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:09.199019 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4cc685632d48239904ee7af7a553ae, user_id=17cbbd39accd405487d0eb02fc9a1b4d, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:09.201732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:09.213935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1371/2752] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:27:09 2022] PUT /identity/v3/projects/5f4cc685632d48239904ee7af7a553ae/users/17cbbd39accd405487d0eb02fc9a1b4d/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:09.224412 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:09.225397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:09.225531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:09.253068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] MFA Rules not processed for user `17cbbd39accd405487d0eb02fc9a1b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:09.254273 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:09.319289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1382/2753] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:27:09.329930 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:09.331639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:09.388759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5f999-595b-4d6b-ad9d-e652f09b14a1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:09.392321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:09.392932 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:09.393214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:09.393488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:09.402327 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:09.403699 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:09.412625 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1372/2754] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:15.051161 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:15.053245 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:15.110601 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e04c92-f899-4c52-b802-0f07fd1653ce None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:15.114387 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:15.115506 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:15.115780 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:15.116077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:15.117787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:15.186411 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:15.187868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:15.200032 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1383/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:18.361453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:18.362922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:18.378062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445424-3c56-43eb-bc09-d434540f332a service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:18.382585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:18.383234 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:18.383511 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:18.383781 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] PATH_INFO: `/v3/users/c444d49243af4f2994bdc510e59dbe5b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:18.384922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c444d49243af4f2994bdc510e59dbe5b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:18.386820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:18.389154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:18.434485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c444d49243af4f2994bdc510e59dbe5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.441437 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c444d49243af4f2994bdc510e59dbe5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.442117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c444d49243af4f2994bdc510e59dbe5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.453884 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c444d49243af4f2994bdc510e59dbe5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.461107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3567b9a3-199c-4d41-81d1-d08e27525e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c444d49243af4f2994bdc510e59dbe5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.467696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1373/2756] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:18 2022] DELETE /identity/v3/users/c444d49243af4f2994bdc510e59dbe5b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:18.651906 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:18.663294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabe25c-2756-4bfa-a761-077fa2ed3a72 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:18.675849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:18.726427 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:18.727063 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:18.727347 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:18.727617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] PATH_INFO: `/v3/projects/a2bd19c620054cfa85530fdf1ae52b5a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:18.729248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bd19c620054cfa85530fdf1ae52b5a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:18.731285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:18.782955 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bd19c620054cfa85530fdf1ae52b5a', 'request_id': 'req-48922bd3-68a7-44df-9f54-5fc8639abb1f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.790067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bd19c620054cfa85530fdf1ae52b5a', 'request_id': 'req-48922bd3-68a7-44df-9f54-5fc8639abb1f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.797562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bd19c620054cfa85530fdf1ae52b5a', 'request_id': 'req-48922bd3-68a7-44df-9f54-5fc8639abb1f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.808516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] The token cache is being invalidate because project a2bd19c620054cfa85530fdf1ae52b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:18.808783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.809405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48922bd3-68a7-44df-9f54-5fc8639abb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:18.810879 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1384/2757] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:18 2022] DELETE /identity/v3/projects/a2bd19c620054cfa85530fdf1ae52b5a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:18.815871 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:18.816203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:18.816484 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:18.836002 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:18.837142 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:18.894188 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1374/2758] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:18.903531 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:18.903817 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:18.904127 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:18.923441 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:18.924700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:18.932547 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1385/2759] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:18.936759 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:18.946755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854614c-8e0b-4ec4-ae31-b7e616a1ba23 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:18.951291 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:18.951882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:18.952194 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:18.952464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:18.953101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:27:18.953402 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:18.954987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:18.966851 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1375/2760] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:27:18.970900 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:18.980077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27247e87-a8a0-45d9-a1f2-7f3a214933d3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:18.984761 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:18.985356 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:18.985635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:18.985907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:18.986536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:18.988497 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.015618 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1386/2761] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:27:19.019582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.030057 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aec0c-4c5d-4687-999c-54b21b05ddbc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.086530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.087060 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.087338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.087608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.088268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.090166 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.104644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:19.110957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1376/2762] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:27:19 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:27:19.114995 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.125392 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b02710-abd2-4eb5-a98a-0930ce898d72 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.130004 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.131132 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.131404 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.131676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.132384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.133972 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.147320 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1387/2763] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:27:19.148498 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.158562 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5fdb4-0563-4d1e-80ed-06e6290c2667 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.163501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb32e4e-d384-4e78-bdc4-4bc05ac88820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.164148 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32e4e-d384-4e78-bdc4-4bc05ac88820 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.164431 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32e4e-d384-4e78-bdc4-4bc05ac88820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.164704 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32e4e-d384-4e78-bdc4-4bc05ac88820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.165343 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb32e4e-d384-4e78-bdc4-4bc05ac88820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.166936 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb32e4e-d384-4e78-bdc4-4bc05ac88820 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.177780 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1377/2764] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:27:19.182280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.193851 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638ae5-4a20-49cb-81a5-d6982dd75a2b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.199062 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.199729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.200047 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.200328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] PATH_INFO: `/v3/projects/e148288ca0e4475fb1b58b8e96646d5f/users/55ea4b4180204dcbadc6b3cf033e151f/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.216848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e148288ca0e4475fb1b58b8e96646d5f, user_id=55ea4b4180204dcbadc6b3cf033e151f, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.219541 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.232462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1388/2765] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:27:19 2022] PUT /identity/v3/projects/e148288ca0e4475fb1b58b8e96646d5f/users/55ea4b4180204dcbadc6b3cf033e151f/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:19.237497 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.238043 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.238680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.257807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:19.259000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:19.316707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1378/2766] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:19.327079 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.328828 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:19.373604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:19.386803 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4273-b509-4f8e-b371-97f7934d4e42 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.390421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674891-8275-463b-b716-3406118bc84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.391020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674891-8275-463b-b716-3406118bc84c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.391295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674891-8275-463b-b716-3406118bc84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.391563 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674891-8275-463b-b716-3406118bc84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.400322 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09674891-8275-463b-b716-3406118bc84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.401745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09674891-8275-463b-b716-3406118bc84c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.411214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1389/2767] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:19.621952 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.623584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:19.636181 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3753-9632-4a07-a885-8d9e4b215b23 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.640718 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.641337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.641612 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.641883 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] PATH_INFO: `/v3/users/17cbbd39accd405487d0eb02fc9a1b4d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.642982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cbbd39accd405487d0eb02fc9a1b4d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.644922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.691630 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cbbd39accd405487d0eb02fc9a1b4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:19.701480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cbbd39accd405487d0eb02fc9a1b4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:19.702280 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cbbd39accd405487d0eb02fc9a1b4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:19.714982 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cbbd39accd405487d0eb02fc9a1b4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:19.722823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cbbd39accd405487d0eb02fc9a1b4d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:19.733835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1379/2768] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:19 2022] DELETE /identity/v3/users/17cbbd39accd405487d0eb02fc9a1b4d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:19.735638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.736191 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.736523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.757526 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:19.758707 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:19.824768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1390/2769] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:19.835347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:19.836810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:19.897669 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0115fc-4e74-4829-9d69-7c32730ce4ab admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:19.901161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010bb4a-1cd9-4993-a954-2963088d3874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:19.901752 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bb4a-1cd9-4993-a954-2963088d3874 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:19.902028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bb4a-1cd9-4993-a954-2963088d3874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:19.902296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bb4a-1cd9-4993-a954-2963088d3874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:19.912593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010bb4a-1cd9-4993-a954-2963088d3874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:19.914016 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010bb4a-1cd9-4993-a954-2963088d3874 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:19.923708 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1380/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:20.336452 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:20.338068 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:20.352458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0ab32-5d27-4567-a513-1af5fd04f3d5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:20.357683 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:20.358516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:20.358893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:20.359264 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] PATH_INFO: `/v3/projects/5f4cc685632d48239904ee7af7a553ae` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:20.360535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4cc685632d48239904ee7af7a553ae)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:20.362565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:20.420373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4cc685632d48239904ee7af7a553ae', 'request_id': 'req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:20.426598 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4cc685632d48239904ee7af7a553ae', 'request_id': 'req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:20.435678 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4cc685632d48239904ee7af7a553ae', 'request_id': 'req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:20.448974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] The token cache is being invalidate because project 5f4cc685632d48239904ee7af7a553ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:20.448974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:20.449956 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:20.451638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1391/2771] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:20 2022] DELETE /identity/v3/projects/5f4cc685632d48239904ee7af7a553ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:23.455018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33fd05-c344-45d9-a41e-fbfc1438af5c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:23.455563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33fd05-c344-45d9-a41e-fbfc1438af5c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:23.455671 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33fd05-c344-45d9-a41e-fbfc1438af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:23.464819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:23.489055 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9c33fd05-c344-45d9-a41e-fbfc1438af5c None None] MFA Rules not processed for user `55ea4b4180204dcbadc6b3cf033e151f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:23.490315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9c33fd05-c344-45d9-a41e-fbfc1438af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:23.560018 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1381/2772] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:27:23.575244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:23.577366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:23.658758 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffc35-97d4-4f20-b9f9-b971a5b669c8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:23.664629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:23.665243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:23.665544 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:23.665822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:23.670768 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:23.675259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:23.677137 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:23.687611 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1392/2773] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:24.983757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:24.984293 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:24.984396 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:25.003816 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] MFA Rules not processed for user `55ea4b4180204dcbadc6b3cf033e151f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:27:25.005036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:25.012226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1382/2774] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:27:33.688082 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:34.998679 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=34 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:36.253418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:36.265521 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a169-dbd2-437f-a8be-9ec3a2f2584f service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:36.271973 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:36.272583 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:36.272870 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:36.273145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:36.274889 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:36.288213 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:36.289806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:36.300395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1393/2775] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:42.232468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:42.233949 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:42.289901 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c655bc-a381-4285-b0d0-98edbe62df62 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:42.293424 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:42.294030 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:42.294309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:42.294582 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:42.296485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:42.360347 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:42.361797 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:42.372239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1383/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:27:46.295894 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:48.500959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:48.502486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:48.516067 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4a6dd-a897-40d4-877d-7341e3821ad1 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:48.521508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:48.522167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:48.522450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:48.522902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] PATH_INFO: `/v3/users/51201e0d81784c50878c46897674dcaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:48.524560 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51201e0d81784c50878c46897674dcaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:48.526701 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:48.577177 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51201e0d81784c50878c46897674dcaf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.577839 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51201e0d81784c50878c46897674dcaf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.578458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51201e0d81784c50878c46897674dcaf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.591731 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51201e0d81784c50878c46897674dcaf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.599617 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51201e0d81784c50878c46897674dcaf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.613371 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1394/2777] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:48 2022] DELETE /identity/v3/users/51201e0d81784c50878c46897674dcaf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:48.787302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:48.797571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66f2b0-df71-4edb-8712-1c4780b65b8f service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:48.854229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:48.854856 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:48.855132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:48.855400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] PATH_INFO: `/v3/projects/629b320d18414a259897bbc8410961e6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:48.856527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=629b320d18414a259897bbc8410961e6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:48.858422 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:48.902684 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629b320d18414a259897bbc8410961e6', 'request_id': 'req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.904521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:48.909129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629b320d18414a259897bbc8410961e6', 'request_id': 'req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.916457 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629b320d18414a259897bbc8410961e6', 'request_id': 'req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.927606 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] The token cache is being invalidate because project 629b320d18414a259897bbc8410961e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:48.927897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.928554 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:48.930029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1384/2778] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:48 2022] DELETE /identity/v3/projects/629b320d18414a259897bbc8410961e6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:27:48.934025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:48.935415 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:48.948808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ff5fd-d81e-4c81-8571-414124e4a39a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:49.004385 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:49.005010 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:49.005288 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:49.005558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] PATH_INFO: `/v3/users/9fb91daa8faf417bab024d18859d8405` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:49.006668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb91daa8faf417bab024d18859d8405)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:49.008629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:49.054150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb91daa8faf417bab024d18859d8405'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.054720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb91daa8faf417bab024d18859d8405'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.055312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb91daa8faf417bab024d18859d8405'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.067512 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb91daa8faf417bab024d18859d8405'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.074220 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb91daa8faf417bab024d18859d8405'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.075836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:49.088539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1395/2779] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:27:48 2022] DELETE /identity/v3/users/9fb91daa8faf417bab024d18859d8405 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:27:49.264163 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:27:49.265613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:27:49.278758 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61190-e0b3-42f4-adc3-d76eccfa7c7c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:27:49.339464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:27:49.340054 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:27:49.340337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:27:49.340607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] PATH_INFO: `/v3/projects/eca08163468d438e9887456443260e84` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:27:49.341705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca08163468d438e9887456443260e84)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:27:49.343599 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:27:49.389003 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca08163468d438e9887456443260e84', 'request_id': 'req-97530f36-a31b-4076-91f6-942049da51c2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.394515 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca08163468d438e9887456443260e84', 'request_id': 'req-97530f36-a31b-4076-91f6-942049da51c2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.401407 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca08163468d438e9887456443260e84', 'request_id': 'req-97530f36-a31b-4076-91f6-942049da51c2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.413048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] The token cache is being invalidate because project eca08163468d438e9887456443260e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:27:49.413466 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.414099 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-97530f36-a31b-4076-91f6-942049da51c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:27:49.415823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1385/2780] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:27:49 2022] DELETE /identity/v3/projects/eca08163468d438e9887456443260e84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:27:59.087729 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:59.409784 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:35.394888 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:28:35.396326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:28:35.530328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8e86-4d47-43a6-8254-be0e9f0344a5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:28:35.588202 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:28:35.588809 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:28:35.589091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:28:35.589366 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:28:35.591091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:28:35.602323 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:28:35.603903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:28:35.613686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1396/2781] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:28:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:28:45.609446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:59.665389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:29:59.665940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:29:59.665940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:29:59.685231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] MFA Rules not processed for user `55ea4b4180204dcbadc6b3cf033e151f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:29:59.686436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:29:59.740189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1386/2782] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:30:09.732789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=25 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:30:48.173308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:30:48.174709 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:30:48.250700 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990c360-c40d-4908-8e80-b6b4c55ec9ad service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:30:48.254868 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:30:48.255465 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:30:48.255745 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:30:48.256061 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:30:48.257770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:30:48.349024 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:30:48.350391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:30:48.371382 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1397/2783] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:30:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:30:51.227783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:30:51.229218 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:30:51.241500 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffdcbe-0c40-489e-9912-c39dff5b6f00 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:30:51.245048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:30:51.245641 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:30:51.245922 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:30:51.246192 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:30:51.247836 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:30:51.261467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:30:51.262938 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:30:51.274027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1387/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:30:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:30:58.368708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=75 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.269034 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:07.777292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:07.778985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:07.795057 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a5fc-034a-4139-992b-2c3fc465f498 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:07.803140 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:07.803926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:07.804307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:07.804655 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:07.806578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:07.824470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:07.827253 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:07.862847 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1398/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:07.895053 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:07.896645 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:08.003425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb022837-b63c-4dca-acf5-46706c3ac5e4 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.007811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.008458 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.008739 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.009008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] PATH_INFO: `/v3/users/55ea4b4180204dcbadc6b3cf033e151f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.010138 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ea4b4180204dcbadc6b3cf033e151f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.012077 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.056382 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ea4b4180204dcbadc6b3cf033e151f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.063100 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ea4b4180204dcbadc6b3cf033e151f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.063757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ea4b4180204dcbadc6b3cf033e151f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.075858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ea4b4180204dcbadc6b3cf033e151f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.083216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3091175f-8282-4a35-9dde-85d4371422c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ea4b4180204dcbadc6b3cf033e151f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.089015 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1388/2786] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:31:07 2022] DELETE /identity/v3/users/55ea4b4180204dcbadc6b3cf033e151f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:08.261379 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.274355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682723a9-3104-4ec8-b2c8-28e77d7b1cea service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.331238 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.331869 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.332184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.332455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] PATH_INFO: `/v3/projects/e148288ca0e4475fb1b58b8e96646d5f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.333566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e148288ca0e4475fb1b58b8e96646d5f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.335792 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.380345 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e148288ca0e4475fb1b58b8e96646d5f', 'request_id': 'req-664c7819-c4ac-4502-a7b2-3f54b12614ea'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.385711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e148288ca0e4475fb1b58b8e96646d5f', 'request_id': 'req-664c7819-c4ac-4502-a7b2-3f54b12614ea'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.393535 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e148288ca0e4475fb1b58b8e96646d5f', 'request_id': 'req-664c7819-c4ac-4502-a7b2-3f54b12614ea'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.404681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] The token cache is being invalidate because project e148288ca0e4475fb1b58b8e96646d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:31:08.404965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.405646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-664c7819-c4ac-4502-a7b2-3f54b12614ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:08.407179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1399/2787] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:31:08 2022] DELETE /identity/v3/projects/e148288ca0e4475fb1b58b8e96646d5f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:08.412179 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.412492 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.412794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.468389 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:08.469613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:08.482558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:08.529563 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1389/2788] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:08.537395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.537684 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.537985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.557446 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:08.558632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:08.566982 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1400/2789] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:31:08.571145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.580783 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd7eb-a9da-485d-88c2-895631ca68f6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.585296 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.585892 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.586168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.586436 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.587072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:31:08.587371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.588983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.600131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1390/2790] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:31:08.604251 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.613718 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e019-da21-439d-9537-5727e4765fb0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.618327 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.618929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.619186 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.619479 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.620136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.622015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.658469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1401/2791] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:08.662566 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.672294 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4692bae-bc8f-4934-9b93-9ca02834e1ab admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.728791 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.729406 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.729690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.729961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.730593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.732557 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.754607 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1391/2792] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:31:08 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:08.758719 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.769254 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e214b3-7213-4f08-b3aa-3e06534fa8fb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.773923 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.774522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.774802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.775076 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.775717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.777381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.787436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1402/2793] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:08.791056 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.801741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef9eff-c9bf-407e-b6fd-ec4dc2e34783 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.806318 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259aad7-bed1-4e75-bd3a-9b747e2aee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.806915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259aad7-bed1-4e75-bd3a-9b747e2aee18 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.807198 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259aad7-bed1-4e75-bd3a-9b747e2aee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.807470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259aad7-bed1-4e75-bd3a-9b747e2aee18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.808561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259aad7-bed1-4e75-bd3a-9b747e2aee18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.810373 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259aad7-bed1-4e75-bd3a-9b747e2aee18 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.821508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1392/2794] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:08.825582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.835522 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa743160-0b15-47c1-8d36-6a67a4635528 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:08.840124 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:08.840766 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.841044 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.841317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] PATH_INFO: `/v3/projects/bb4d9f63802845449d05753a99570f11/users/093b4513e1704594972dcc4a85042a87/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.856200 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4d9f63802845449d05753a99570f11, user_id=093b4513e1704594972dcc4a85042a87, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:08.858857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:08.872665 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1403/2795] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:08 2022] PUT /identity/v3/projects/bb4d9f63802845449d05753a99570f11/users/093b4513e1704594972dcc4a85042a87/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:08.882773 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:08.883061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:08.883340 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:08.910909 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] MFA Rules not processed for user `093b4513e1704594972dcc4a85042a87`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:08.912158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:08.974072 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1393/2796] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:08.985248 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:08.987568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:08.994088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:09.063224 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287a23-c213-4f1a-a677-b3ddcc7fcfd1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:09.068853 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc7f8-572b-4c37-b335-fcbbc3d18aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:09.069458 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc7f8-572b-4c37-b335-fcbbc3d18aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:09.069739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc7f8-572b-4c37-b335-fcbbc3d18aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:09.070013 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc7f8-572b-4c37-b335-fcbbc3d18aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:09.077605 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc7f8-572b-4c37-b335-fcbbc3d18aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:09.079194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc7f8-572b-4c37-b335-fcbbc3d18aa3 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:09.087909 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1404/2797] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:14.235542 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:14.251076 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:14.296468 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3905-66a7-4ca3-8f68-9f45349284bd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:14.300920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:14.301546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:14.301828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:14.302103 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] PATH_INFO: `/v3/users/093b4513e1704594972dcc4a85042a87` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:14.303219 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=093b4513e1704594972dcc4a85042a87)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:14.305177 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:14.351303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093b4513e1704594972dcc4a85042a87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.358014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093b4513e1704594972dcc4a85042a87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.358681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093b4513e1704594972dcc4a85042a87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.370274 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093b4513e1704594972dcc4a85042a87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.377375 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093b4513e1704594972dcc4a85042a87'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.383800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1394/2798] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:31:14 2022] DELETE /identity/v3/users/093b4513e1704594972dcc4a85042a87 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:14.388365 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:14.388823 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:14.388938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:14.408043 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:14.409313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:14.467223 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1405/2799] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:14.476986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:14.478593 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:14.556107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df193-80bd-4205-ad8c-0512c3f2e75e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:14.559745 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca5ad1-c4a5-4a5d-94d0-a936a4377750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:14.560362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca5ad1-c4a5-4a5d-94d0-a936a4377750 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:14.560637 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca5ad1-c4a5-4a5d-94d0-a936a4377750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:14.560907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca5ad1-c4a5-4a5d-94d0-a936a4377750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:14.570321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca5ad1-c4a5-4a5d-94d0-a936a4377750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:14.571775 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca5ad1-c4a5-4a5d-94d0-a936a4377750 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:14.581107 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1395/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:14.845720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:14.847685 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:14.859818 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad06c-5d3a-4f88-9142-4f9ec07a5c8f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:14.865105 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:14.865739 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:14.866051 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:14.866321 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] PATH_INFO: `/v3/projects/bb4d9f63802845449d05753a99570f11` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:14.867455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4d9f63802845449d05753a99570f11)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:14.869406 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:14.916524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4d9f63802845449d05753a99570f11', 'request_id': 'req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.922108 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4d9f63802845449d05753a99570f11', 'request_id': 'req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.930033 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4d9f63802845449d05753a99570f11', 'request_id': 'req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.941049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] The token cache is being invalidate because project bb4d9f63802845449d05753a99570f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:31:14.941330 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.941946 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2adb30ce-0dcd-43f4-8e13-201bd584f2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:14.943432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1406/2801] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:31:14 2022] DELETE /identity/v3/projects/bb4d9f63802845449d05753a99570f11 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:14.948441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09469c-6856-457b-a706-4e562314241e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:14.948730 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09469c-6856-457b-a706-4e562314241e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:14.949008 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09469c-6856-457b-a706-4e562314241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:14.967859 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-be09469c-6856-457b-a706-4e562314241e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:14.969092 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-be09469c-6856-457b-a706-4e562314241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:14.981247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:15.028494 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1396/2802] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:15.037860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.038146 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.038418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.058558 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:15.059782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:15.067677 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1407/2803] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:15.071681 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09469c-6856-457b-a706-4e562314241e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.081147 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09469c-6856-457b-a706-4e562314241e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.086322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.086915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.087193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.087464 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.088169 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:31:15.088471 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.090064 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.101757 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1397/2804] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:31:15.106000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.115705 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c3c0-c8a2-4202-ac0b-296121a82ee5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.120420 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.121016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.121302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.121576 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.122195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.124143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.128602 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:15.153059 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1408/2805] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:31:15 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:15.157429 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.167597 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689958-f35e-4f42-b664-5b5e626ef5a8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.222639 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.223251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.223528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.223800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.224462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.226370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.245983 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1398/2806] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:31:15 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:15.250015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.260219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e68ac-d55d-4f7f-8c80-decc33eac8f0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.264798 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.265389 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.265664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.265931 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.266566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.268181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.278490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1409/2807] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:15.282551 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.292947 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91083a0-5db2-4196-91ea-81fa05297bf4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.297448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cbba9-6113-4fbf-862f-69aef8e55634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.298031 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cbba9-6113-4fbf-862f-69aef8e55634 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.298309 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cbba9-6113-4fbf-862f-69aef8e55634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.298581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cbba9-6113-4fbf-862f-69aef8e55634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.299216 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cbba9-6113-4fbf-862f-69aef8e55634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.300825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cbba9-6113-4fbf-862f-69aef8e55634 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.311176 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1399/2808] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:15.314978 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.325377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f124-fba7-4d8a-a066-c80cbc015409 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.330317 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.330965 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.331751 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.332055 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] PATH_INFO: `/v3/projects/e2e07765e32449fabd3928ce5e6e98ed/users/e85e80d78b1c4e66b32e034b184c8d92/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.347508 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e07765e32449fabd3928ce5e6e98ed, user_id=e85e80d78b1c4e66b32e034b184c8d92, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.350189 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.362485 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1410/2809] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:15 2022] PUT /identity/v3/projects/e2e07765e32449fabd3928ce5e6e98ed/users/e85e80d78b1c4e66b32e034b184c8d92/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:31:15.372558 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.372850 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.373130 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.400371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] MFA Rules not processed for user `e85e80d78b1c4e66b32e034b184c8d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:15.401609 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:15.465205 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1400/2810] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:15.476471 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:15.478107 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:15.533326 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695ef21-87a8-477b-aeee-047aba5edd76 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:15.537747 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb400b-60a4-48ac-bbf0-647c73ffe023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:15.538348 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb400b-60a4-48ac-bbf0-647c73ffe023 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:15.538629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb400b-60a4-48ac-bbf0-647c73ffe023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:15.538902 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb400b-60a4-48ac-bbf0-647c73ffe023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:15.546974 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb400b-60a4-48ac-bbf0-647c73ffe023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:15.548440 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb400b-60a4-48ac-bbf0-647c73ffe023 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:15.557091 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1411/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:23.834124 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:23.846898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:23.895657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11e9b9-7f81-4015-9cb4-ff47f1596831 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:23.900189 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:23.900809 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:23.901087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:23.901358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] PATH_INFO: `/v3/users/e85e80d78b1c4e66b32e034b184c8d92` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:23.902460 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85e80d78b1c4e66b32e034b184c8d92)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:23.904409 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:23.949869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85e80d78b1c4e66b32e034b184c8d92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:23.956768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85e80d78b1c4e66b32e034b184c8d92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:23.957427 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85e80d78b1c4e66b32e034b184c8d92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:23.968980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85e80d78b1c4e66b32e034b184c8d92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:23.976782 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85e80d78b1c4e66b32e034b184c8d92'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:23.982665 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1401/2812] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:31:23 2022] DELETE /identity/v3/users/e85e80d78b1c4e66b32e034b184c8d92 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:23.987101 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:23.987555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:23.987668 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.006530 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:24.007651 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:24.065100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1412/2813] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:24.075259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.076712 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:24.131499 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231e34-39de-429a-8b00-5db0a4f946af admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.135059 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eea40-a9f1-483d-897c-b95f6e605840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.135646 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eea40-a9f1-483d-897c-b95f6e605840 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.135920 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eea40-a9f1-483d-897c-b95f6e605840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.136236 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eea40-a9f1-483d-897c-b95f6e605840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.144842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eea40-a9f1-483d-897c-b95f6e605840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.146955 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eea40-a9f1-483d-897c-b95f6e605840 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.156045 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1402/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 14:31:24.419641 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.421136 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:24.433717 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16def1a-3739-40ed-a312-e49eb7e30c7a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.438381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.439015 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.439296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.439568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] PATH_INFO: `/v3/projects/e2e07765e32449fabd3928ce5e6e98ed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.440777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e07765e32449fabd3928ce5e6e98ed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.442702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.488738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:24.490421 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e07765e32449fabd3928ce5e6e98ed', 'request_id': 'req-c790f246-860e-4959-b1f8-d932589cea65'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:24.496886 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e07765e32449fabd3928ce5e6e98ed', 'request_id': 'req-c790f246-860e-4959-b1f8-d932589cea65'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:24.504194 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e07765e32449fabd3928ce5e6e98ed', 'request_id': 'req-c790f246-860e-4959-b1f8-d932589cea65'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:24.515568 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] The token cache is being invalidate because project e2e07765e32449fabd3928ce5e6e98ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:31:24.515850 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:24.516494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c790f246-860e-4959-b1f8-d932589cea65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:24.517960 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1413/2815] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:31:24 2022] DELETE /identity/v3/projects/e2e07765e32449fabd3928ce5e6e98ed => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:24.522789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.523225 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.523693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.542707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:24.543835 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:24.573214 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:24.602364 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1403/2816] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 14:31:24.610150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.610436 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.610711 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.630511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:24.631702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:24.639545 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1414/2817] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:24.643546 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.652991 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb434-8ea0-4a46-828c-8da5461aa659 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.657858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.658450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.658725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.659105 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.659896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:31:24.660230 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.662331 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.673391 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1404/2818] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:31:24.678171 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.687349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844eb48-da7e-4f48-bf4a-e9149ef6dc7b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.691921 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.692543 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.692825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.693150 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.693778 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.695676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.722455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1415/2819] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:31:24 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:24.727132 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.737239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59192db5-738a-4e13-a1e2-13a3f7750d9f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.794257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.794789 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.795068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.795358 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.795979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.797897 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.818583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1405/2820] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:31:24 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:24.823049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.833175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84830f-288b-48e3-b503-0598767a2628 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.837832 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.838498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.838782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.839052 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.839696 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.841324 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.851621 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1416/2821] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:24.855266 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.865038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588f1e2-e7e8-4f3d-b1a9-38b056ee345b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.870321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b91c1-b536-4af5-a91c-69159ba56a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.870910 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b91c1-b536-4af5-a91c-69159ba56a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.871190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b91c1-b536-4af5-a91c-69159ba56a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.871463 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b91c1-b536-4af5-a91c-69159ba56a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.872134 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b91c1-b536-4af5-a91c-69159ba56a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.873725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b91c1-b536-4af5-a91c-69159ba56a65 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.883929 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1406/2822] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 14:31:24.887826 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:24.897490 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664c21-8aed-4e15-8b8a-99b60bf574f9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:24.902089 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:24.902720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.902996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.903265 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] PATH_INFO: `/v3/projects/d4f6b0e034e14219ad3cedec05d518d7/users/cc5c5ec699c94c27be2458c458f6ae5e/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.918143 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f6b0e034e14219ad3cedec05d518d7, user_id=cc5c5ec699c94c27be2458c458f6ae5e, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:24.920810 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:24.934159 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1417/2823] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:24 2022] PUT /identity/v3/projects/d4f6b0e034e14219ad3cedec05d518d7/users/cc5c5ec699c94c27be2458c458f6ae5e/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:24.945243 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:24.945531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:24.945802 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:24.973323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] MFA Rules not processed for user `cc5c5ec699c94c27be2458c458f6ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:24.974526 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:25.036527 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1407/2824] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:25.041698 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.103028 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edd59-e7f6-4b88-be66-2f53cd4df715 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.107638 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.108278 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.108562 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.108835 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.109455 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.111360 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.136836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1418/2825] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:31:25 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:25.140872 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.151749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ce9e6-4cda-40cd-8213-7f553539d16a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.180328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:25.207818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.208451 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.208729 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.208998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.210155 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.212091 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.232114 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1408/2826] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:31:25 2022] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:25.236041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.246250 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d723d-d20f-4791-bb75-3005ecfd87d8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.250762 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.251354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.251630 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.251899 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.252573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.254162 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.264461 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1419/2827] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:25.268483 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.278651 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3006-d711-450f-9121-12858a6ee5e7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.283446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.284119 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.284398 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.284668 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] PATH_INFO: `/v3/projects/b3ae17e6513d4c26af1984158bec90c4/users/8de3e4b49f394457a826e2dce19ba175/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.299362 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ae17e6513d4c26af1984158bec90c4, user_id=8de3e4b49f394457a826e2dce19ba175, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.302036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.315203 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1409/2828] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:25 2022] PUT /identity/v3/projects/b3ae17e6513d4c26af1984158bec90c4/users/8de3e4b49f394457a826e2dce19ba175/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:25.319559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.329720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a633d-6994-4bcd-aad7-9db5d311f142 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.373021 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:25.387390 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63502b-ce34-45a8-bc0e-7cfd29c5570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.388020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63502b-ce34-45a8-bc0e-7cfd29c5570d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.388302 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63502b-ce34-45a8-bc0e-7cfd29c5570d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.388573 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63502b-ce34-45a8-bc0e-7cfd29c5570d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.389206 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63502b-ce34-45a8-bc0e-7cfd29c5570d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.390816 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63502b-ce34-45a8-bc0e-7cfd29c5570d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.400959 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1420/2829] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:25.405063 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.415561 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332883-f52e-4252-8ad3-36a105351abb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.420295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.420961 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.421247 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.421525 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] PATH_INFO: `/v3/projects/b3ae17e6513d4c26af1984158bec90c4/users/8de3e4b49f394457a826e2dce19ba175/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.423578 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ae17e6513d4c26af1984158bec90c4, user_id=8de3e4b49f394457a826e2dce19ba175, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.426288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.436413 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1410/2830] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:25 2022] PUT /identity/v3/projects/b3ae17e6513d4c26af1984158bec90c4/users/8de3e4b49f394457a826e2dce19ba175/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:25.446947 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.447256 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.447557 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.475022 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] MFA Rules not processed for user `8de3e4b49f394457a826e2dce19ba175`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:25.476259 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:25.543034 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1421/2831] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:25.553613 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.555488 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:25.611229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365bb7f-5535-4a4f-affa-e8388207544b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.614790 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.615383 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.615657 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.615921 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.625145 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.626505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.636110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1411/2832] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:25.783470 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:25.793088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fed1b9-ae58-4035-8893-fe91de1bacba None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:25.796640 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe180-c433-4684-a5d9-ec47c6fc8df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:25.797239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe180-c433-4684-a5d9-ec47c6fc8df1 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:25.797516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe180-c433-4684-a5d9-ec47c6fc8df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:25.797786 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe180-c433-4684-a5d9-ec47c6fc8df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:25.853907 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebe180-c433-4684-a5d9-ec47c6fc8df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:25.855349 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebe180-c433-4684-a5d9-ec47c6fc8df1 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:25.864266 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1422/2833] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:31.078986 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:31.139319 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279af0e-5ba4-4f32-82ab-38c0876418b7 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:31.143798 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:31.144443 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:31.144721 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:31.144988 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] PATH_INFO: `/v3/users/cc5c5ec699c94c27be2458c458f6ae5e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:31.146084 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5c5ec699c94c27be2458c458f6ae5e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:31.148000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:31.175014 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:31.192604 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5c5ec699c94c27be2458c458f6ae5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.199811 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5c5ec699c94c27be2458c458f6ae5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.200485 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5c5ec699c94c27be2458c458f6ae5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.211842 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5c5ec699c94c27be2458c458f6ae5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.218819 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5c5ec699c94c27be2458c458f6ae5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.224736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1412/2834] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:31:31 2022] DELETE /identity/v3/users/cc5c5ec699c94c27be2458c458f6ae5e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:31.229295 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:31.229805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:31.229903 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:31.248825 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:31.250017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:31.307307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1423/2835] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:31.316844 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:31.318306 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:31.373584 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d578f4d-a2db-40ea-9d81-c797050c162b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:31.377112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:31.377707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:31.377981 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:31.378248 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:31.387338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:31.388769 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:31.398017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1413/2836] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:31.664584 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:31.666085 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:31.678400 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d750f-3ad9-4e64-91a6-531702ca9f1e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:31.683496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:31.684167 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:31.684449 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:31.684724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] PATH_INFO: `/v3/projects/d4f6b0e034e14219ad3cedec05d518d7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:31.685887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f6b0e034e14219ad3cedec05d518d7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:31.687804 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:31.689432 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:31.736794 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f6b0e034e14219ad3cedec05d518d7', 'request_id': 'req-af9733e1-4e79-4455-a202-826d4d66867f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.742660 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f6b0e034e14219ad3cedec05d518d7', 'request_id': 'req-af9733e1-4e79-4455-a202-826d4d66867f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.750971 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f6b0e034e14219ad3cedec05d518d7', 'request_id': 'req-af9733e1-4e79-4455-a202-826d4d66867f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.762852 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] The token cache is being invalidate because project d4f6b0e034e14219ad3cedec05d518d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:31:31.763163 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.763793 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.765299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1424/2837] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:31:31 2022] DELETE /identity/v3/projects/d4f6b0e034e14219ad3cedec05d518d7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:31.769229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:31.778705 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea72b5-4c83-4973-ac14-572067bddf1d service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:31.834800 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:31.835456 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:31.835680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:31.835945 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] PATH_INFO: `/v3/users/8de3e4b49f394457a826e2dce19ba175` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:31.837117 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de3e4b49f394457a826e2dce19ba175)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:31.839144 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:31.884860 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de3e4b49f394457a826e2dce19ba175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.886760 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:31.893709 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de3e4b49f394457a826e2dce19ba175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.894528 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de3e4b49f394457a826e2dce19ba175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.906414 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de3e4b49f394457a826e2dce19ba175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.913696 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-467999d9-9693-4b51-a5fe-d6ac93484073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de3e4b49f394457a826e2dce19ba175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:31.919509 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1414/2838] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:31:31 2022] DELETE /identity/v3/users/8de3e4b49f394457a826e2dce19ba175 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:32.185372 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.186911 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:32.202475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9733e1-4e79-4455-a202-826d4d66867f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.259507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.260210 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.260424 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.260689 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] PATH_INFO: `/v3/projects/b3ae17e6513d4c26af1984158bec90c4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.261805 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ae17e6513d4c26af1984158bec90c4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.263708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.309380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ae17e6513d4c26af1984158bec90c4', 'request_id': 'req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:32.314895 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ae17e6513d4c26af1984158bec90c4', 'request_id': 'req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:32.321936 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ae17e6513d4c26af1984158bec90c4', 'request_id': 'req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:32.332863 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] The token cache is being invalidate because project b3ae17e6513d4c26af1984158bec90c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:31:32.333145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:32.333771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ae59d0e4-f9a7-4570-b006-0b2dc5c9ed5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:31:32.335225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1425/2839] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:31:32 2022] DELETE /identity/v3/projects/b3ae17e6513d4c26af1984158bec90c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:32.340270 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.340737 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.340865 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.360257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:32.361393 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:32.418348 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1415/2840] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:32.427529 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.427860 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.428120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.447872 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:32.449131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:32.457175 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1426/2841] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:32.461323 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.471374 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160d288-be93-420a-af8a-0e91482b1287 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.475898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.476520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.476801 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.477074 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.478265 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:31:32.478570 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.480182 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.491400 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1416/2842] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:31:32.495483 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.504867 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75c6a8-dd30-4ba8-b897-9b353c9218df None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.509811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.510397 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.510672 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.510938 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.511580 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.513498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.524988 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:32.542546 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1427/2843] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:31:32 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:32.546579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.556470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5cd1f-ca73-4c36-aff4-1e32f4fb5961 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.610915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.611453 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.611736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.612038 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.612695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.614617 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.635417 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1417/2844] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:31:32 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:32.639720 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.650570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef7b2f-e24d-4d1e-b310-fae3207ab3a1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.655280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0693597-673e-434c-8560-abf970778641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.655885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0693597-673e-434c-8560-abf970778641 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.656195 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0693597-673e-434c-8560-abf970778641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.656496 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0693597-673e-434c-8560-abf970778641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.657192 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0693597-673e-434c-8560-abf970778641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.659077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0693597-673e-434c-8560-abf970778641 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.669769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1428/2845] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:32.673337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.683088 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a1e0e-6570-455f-be1a-328fbb231cac admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.687608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa423fe9-eee1-4b29-9f95-357121500abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.688229 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423fe9-eee1-4b29-9f95-357121500abc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.688512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423fe9-eee1-4b29-9f95-357121500abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.688785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423fe9-eee1-4b29-9f95-357121500abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.689420 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423fe9-eee1-4b29-9f95-357121500abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.690996 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423fe9-eee1-4b29-9f95-357121500abc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.701313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1418/2846] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:32.705301 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0693597-673e-434c-8560-abf970778641 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.715629 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0693597-673e-434c-8560-abf970778641 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.720235 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.720877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.721154 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.721425 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] PATH_INFO: `/v3/projects/2103280dc5ff461c8bab6116ef1c711e/users/9b06f36fbb6e4890b746b771d8d19269/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.736532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2103280dc5ff461c8bab6116ef1c711e, user_id=9b06f36fbb6e4890b746b771d8d19269, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.739222 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.752339 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1429/2847] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:32 2022] PUT /identity/v3/projects/2103280dc5ff461c8bab6116ef1c711e/users/9b06f36fbb6e4890b746b771d8d19269/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:32.757493 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926164-de8f-448a-9919-92abc2ee36f6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.757846 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926164-de8f-448a-9919-92abc2ee36f6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.758126 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926164-de8f-448a-9919-92abc2ee36f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.777036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-15926164-de8f-448a-9919-92abc2ee36f6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:32.778239 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-15926164-de8f-448a-9919-92abc2ee36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:32.806583 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:32.836900 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1419/2848] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:32.846635 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:32.848351 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:32.904667 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f83ce-9151-4524-b2cd-3751bd89a1c8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:32.908239 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:32.909118 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:32.909395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:32.909670 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:32.919408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:32.920901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:32.930561 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1430/2849] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:33.526226 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.526719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.526817 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.557533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] MFA Rules not processed for user `9b06f36fbb6e4890b746b771d8d19269`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:33.558911 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:33.625979 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1420/2850] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:33.630565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:33.641120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4cc72-a204-44bd-8798-eb29896d58c0 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:33.645653 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:33.646244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.646523 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.646795 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.647423 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:33.649381 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:33.677462 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1431/2851] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:31:33 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:33.681548 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:33.692061 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c424da-627d-4e61-88b6-f5adbfd90291 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:33.748719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:33.749337 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.749621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.749896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.750520 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:33.752538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:33.773672 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1421/2852] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:31:33 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:31:33.778333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:33.788749 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579e318-0d1d-489f-9408-0c2e16f31006 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:33.793243 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:33.793838 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.794116 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.794384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.795018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:33.796671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:33.806901 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1432/2853] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:33.810714 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:33.820356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181653-dc90-4c6c-b036-4dad835d43c0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:33.825524 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:33.826168 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.826448 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.826717 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] PATH_INFO: `/v3/projects/59fc15293c7e4e8e953947ef9ea9c523/users/5a5bad3ad5c340eba58c9f4130b7372b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.841678 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fc15293c7e4e8e953947ef9ea9c523, user_id=5a5bad3ad5c340eba58c9f4130b7372b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:33.844367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:33.857090 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1422/2854] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:33 2022] PUT /identity/v3/projects/59fc15293c7e4e8e953947ef9ea9c523/users/5a5bad3ad5c340eba58c9f4130b7372b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:33.860890 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:33.870646 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324f57-2edb-442d-8be3-c973cbd039d4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:33.925152 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb6e79-58ae-479f-a418-10ea04ce9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:33.925741 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6e79-58ae-479f-a418-10ea04ce9e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.926018 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6e79-58ae-479f-a418-10ea04ce9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.926285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6e79-58ae-479f-a418-10ea04ce9e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.926908 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb6e79-58ae-479f-a418-10ea04ce9e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:33.928538 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb6e79-58ae-479f-a418-10ea04ce9e97 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:33.938802 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1433/2855] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:31:33.942732 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:33.953441 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fca1a7-8da4-41bf-971b-7d208f08517b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:33.957989 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760c19f-c3f8-4b14-9bdb-fb1e86fdee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:33.958632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760c19f-c3f8-4b14-9bdb-fb1e86fdee8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:33.958915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760c19f-c3f8-4b14-9bdb-fb1e86fdee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:33.959193 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760c19f-c3f8-4b14-9bdb-fb1e86fdee8f admin admin] PATH_INFO: `/v3/projects/59fc15293c7e4e8e953947ef9ea9c523/users/5a5bad3ad5c340eba58c9f4130b7372b/roles/4cd8ac9aa64446caaf8edf7398ec37ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:33.961112 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760c19f-c3f8-4b14-9bdb-fb1e86fdee8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fc15293c7e4e8e953947ef9ea9c523, user_id=5a5bad3ad5c340eba58c9f4130b7372b, role_id=4cd8ac9aa64446caaf8edf7398ec37ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:33.964000 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760c19f-c3f8-4b14-9bdb-fb1e86fdee8f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:33.974067 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1423/2856] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:31:33 2022] PUT /identity/v3/projects/59fc15293c7e4e8e953947ef9ea9c523/users/5a5bad3ad5c340eba58c9f4130b7372b/roles/4cd8ac9aa64446caaf8edf7398ec37ae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:31:34.587783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:34.588110 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:34.588391 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:34.616587 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] MFA Rules not processed for user `5a5bad3ad5c340eba58c9f4130b7372b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:34.617808 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:34.627559 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:34.692418 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1434/2857] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:34.769211 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:34.769792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:34.769792 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:34.789743 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] MFA Rules not processed for user `9b06f36fbb6e4890b746b771d8d19269`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:31:34.791685 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:34.800804 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:34.846533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1424/2858] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:31:34.858335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:34.859693 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:34.930783 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23c31-2b5c-444a-bf50-2d2c260b951c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:34.936308 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:34.936904 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:34.937179 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:34.937450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:34.944943 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:34.946510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:34.955069 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1435/2859] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:35.179644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:35.231974 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b23158-8c2d-4652-aecd-2f1611d7c278 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:35.235442 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:35.236068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:35.236344 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:35.236608 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:35.238288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:35.247588 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:35.249048 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:35.256890 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1425/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:35.580354 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:35.581767 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:35.652510 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938892b7-f09d-4905-9158-857d53eaa2e0 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:35.657395 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:35.657996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:35.658272 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:35.658540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:35.660519 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:35.671631 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:35.673216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:35.683536 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1436/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:37.332618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:37.334013 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:37.345295 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d2052-8bc0-4d29-bc87-166d56ac5e0d service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:37.348959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:37.349589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:37.349864 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:37.350129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:37.351756 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:37.361027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:37.362450 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:37.370533 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1426/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:38.259857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:38.280692 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b2ec-8fbe-4b92-906f-f18e8e3f29c5 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:38.287396 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:38.288056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:38.288328 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:38.288610 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:38.290380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:38.303848 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:38.305777 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:38.317757 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1437/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:43.626328 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:43.627934 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:43.646725 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae038a-de1a-4b59-abda-46baaf9993bf service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:43.652777 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11ac5634282f478885ee36f51cf7ca55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:43.653380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:43.653662 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:43.653935 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:43.655648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:43.668876 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:43.670490 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:43.688201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1427/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:47.784871 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:31:47.786355 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:31:47.797592 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:47.843944 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f96e-7cfb-4589-9376-2a8bd33dd8c2 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:31:47.847486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:31:47.848131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:31:47.848416 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:31:47.848690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:31:47.858139 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:31:47.859566 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:31:47.868937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1438/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:31:53.677023 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=56 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:57.864772 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=22 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:05.976462 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:05.987810 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c5ae6-da66-4c8a-afe0-c1c0def8c500 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:05.993011 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:05.993695 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:05.994042 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:05.994320 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:05.996206 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:06.008342 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:06.009980 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:06.021501 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1428/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:06.533019 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:06.596822 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474b5b-36f3-4bc7-9dc9-fb15af371bf1 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:06.601380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:06.602008 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:06.602290 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:06.602564 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] PATH_INFO: `/v3/users/9b06f36fbb6e4890b746b771d8d19269` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:06.603690 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b06f36fbb6e4890b746b771d8d19269)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:06.605784 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:06.657016 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b06f36fbb6e4890b746b771d8d19269'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.657604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b06f36fbb6e4890b746b771d8d19269'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.658221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b06f36fbb6e4890b746b771d8d19269'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.670363 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b06f36fbb6e4890b746b771d8d19269'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.677528 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b06f36fbb6e4890b746b771d8d19269'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.690269 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1439/2867] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:32:06 2022] DELETE /identity/v3/users/9b06f36fbb6e4890b746b771d8d19269 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:06.867302 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:06.878036 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a076-e4eb-4ff7-84dd-0c5e49f37065 service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:06.934703 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:06.935268 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:06.935552 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:06.935828 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] PATH_INFO: `/v3/projects/2103280dc5ff461c8bab6116ef1c711e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:06.936998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2103280dc5ff461c8bab6116ef1c711e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:06.938898 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:06.983097 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2103280dc5ff461c8bab6116ef1c711e', 'request_id': 'req-924792a6-49d8-40fb-a33a-80eee0706e21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.988505 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2103280dc5ff461c8bab6116ef1c711e', 'request_id': 'req-924792a6-49d8-40fb-a33a-80eee0706e21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:06.995942 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2103280dc5ff461c8bab6116ef1c711e', 'request_id': 'req-924792a6-49d8-40fb-a33a-80eee0706e21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.007158 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] The token cache is being invalidate because project 2103280dc5ff461c8bab6116ef1c711e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:32:07.007446 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.008116 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.009579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1429/2868] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:32:06 2022] DELETE /identity/v3/projects/2103280dc5ff461c8bab6116ef1c711e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:07.013671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.015097 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:07.028478 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c3d7d-30a1-4ea8-85ad-c8597780dc52 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.083268 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.083893 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.084198 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.084469 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] PATH_INFO: `/v3/users/5a5bad3ad5c340eba58c9f4130b7372b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.085582 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5bad3ad5c340eba58c9f4130b7372b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.087498 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.108172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:07.133604 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5bad3ad5c340eba58c9f4130b7372b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.134252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5bad3ad5c340eba58c9f4130b7372b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.134887 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5bad3ad5c340eba58c9f4130b7372b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.146708 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5bad3ad5c340eba58c9f4130b7372b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.153540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ee277a87-7faa-4de5-be35-94f90d330721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5bad3ad5c340eba58c9f4130b7372b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.166442 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1440/2869] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:32:07 2022] DELETE /identity/v3/users/5a5bad3ad5c340eba58c9f4130b7372b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:07.336136 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.337555 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:07.353772 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924792a6-49d8-40fb-a33a-80eee0706e21 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.409987 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.410621 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.411399 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.411707 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] PATH_INFO: `/v3/projects/59fc15293c7e4e8e953947ef9ea9c523` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.412849 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fc15293c7e4e8e953947ef9ea9c523)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.414807 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.436250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:07.461998 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fc15293c7e4e8e953947ef9ea9c523', 'request_id': 'req-f538c71c-d1e2-45c9-9034-c7f88d60295a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.467303 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fc15293c7e4e8e953947ef9ea9c523', 'request_id': 'req-f538c71c-d1e2-45c9-9034-c7f88d60295a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.475589 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fc15293c7e4e8e953947ef9ea9c523', 'request_id': 'req-f538c71c-d1e2-45c9-9034-c7f88d60295a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.486486 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] The token cache is being invalidate because project 59fc15293c7e4e8e953947ef9ea9c523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:32:07.486768 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.487380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f538c71c-d1e2-45c9-9034-c7f88d60295a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:07.488862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1430/2870] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:32:07 2022] DELETE /identity/v3/projects/59fc15293c7e4e8e953947ef9ea9c523 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:07.494219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.494500 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.494770 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.514088 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:07.515275 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:07.572214 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1441/2871] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:07.579736 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.580051 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.580329 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.600385 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:07.601655 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:07.609926 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1431/2872] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:07.613980 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.624249 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d810c-adfb-4475-a6fc-3de8e97b3688 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.628836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.629477 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.629760 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.630035 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.630686 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:32:07.630990 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.632625 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.644020 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1442/2873] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:32:07.648693 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.657825 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca10e-4f81-4bd3-a6e2-a1b4bb2738b5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.663037 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.663601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.663882 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.664185 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.664868 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.666779 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.693380 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1432/2874] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:32:07 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:32:07.697394 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.707237 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf315f-1985-4b22-81a1-b7afb31f2df7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.764313 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.764939 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.765292 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.765492 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.766121 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.768075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.788307 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1443/2875] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:32:07 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:32:07.792719 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.803632 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f6aa-ff85-4965-91af-9dd0c45bd1b3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.808282 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.808879 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.809161 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.809438 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.810087 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.811690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.823231 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1433/2876] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:32:07.826926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.836877 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b84c6-89b8-4e30-908b-80cf3667bd00 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.841475 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73f9ad-346d-4824-8ed2-fed6c9fb5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.842077 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73f9ad-346d-4824-8ed2-fed6c9fb5ece admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.842338 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73f9ad-346d-4824-8ed2-fed6c9fb5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.842606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73f9ad-346d-4824-8ed2-fed6c9fb5ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.843244 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73f9ad-346d-4824-8ed2-fed6c9fb5ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.844857 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73f9ad-346d-4824-8ed2-fed6c9fb5ece admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.855246 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1444/2877] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:32:07.859101 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:07.869190 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d583aa-4700-4f2b-a1a2-3843250a0fbc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:07.873727 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:07.874367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.874644 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.874915 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] PATH_INFO: `/v3/projects/9836caef79c64603bba4250884f2100c/users/6419a6349c484bfdab36a692ca8913c9/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.889873 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9836caef79c64603bba4250884f2100c, user_id=6419a6349c484bfdab36a692ca8913c9, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:07.892585 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:07.904741 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1434/2878] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:32:07 2022] PUT /identity/v3/projects/9836caef79c64603bba4250884f2100c/users/6419a6349c484bfdab36a692ca8913c9/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:07.915333 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:07.915620 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:07.915919 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:07.924232 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:07.945078 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] MFA Rules not processed for user `6419a6349c484bfdab36a692ca8913c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:07.946312 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.008005 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1445/2879] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:08.019068 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:08.020858 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.076823 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a5221-ca74-42b1-b02a-f6b63b5ea026 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:08.080425 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e381-628c-47cc-99c3-61dea135f15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:08.081021 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e381-628c-47cc-99c3-61dea135f15d service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.081300 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e381-628c-47cc-99c3-61dea135f15d service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.081571 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e381-628c-47cc-99c3-61dea135f15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.089702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e381-628c-47cc-99c3-61dea135f15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:08.091129 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e381-628c-47cc-99c3-61dea135f15d service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:08.100251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1435/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:08.119346 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:08.181699 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701682-90b5-4ef0-aa56-8b0aa8adfb1f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:08.186216 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:08.186837 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.187114 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.187388 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] PATH_INFO: `/v3/users/6419a6349c484bfdab36a692ca8913c9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.188516 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6419a6349c484bfdab36a692ca8913c9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:08.190443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:08.235017 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6419a6349c484bfdab36a692ca8913c9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.235664 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6419a6349c484bfdab36a692ca8913c9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.236299 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6419a6349c484bfdab36a692ca8913c9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.248555 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6419a6349c484bfdab36a692ca8913c9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.255280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6419a6349c484bfdab36a692ca8913c9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.267417 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1446/2881] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:32:08 2022] DELETE /identity/v3/users/6419a6349c484bfdab36a692ca8913c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:08.271755 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.272065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.272338 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.291252 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:08.292735 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.334281 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:08.353814 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1436/2882] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:08.363277 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:08.365444 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.379811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:08.423539 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f60be2-322d-46af-bd34-a478516e3c6f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:08.427184 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251148d6-57bc-4e33-b6b1-73d67078ce37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:08.427787 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251148d6-57bc-4e33-b6b1-73d67078ce37 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.428100 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251148d6-57bc-4e33-b6b1-73d67078ce37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.428373 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251148d6-57bc-4e33-b6b1-73d67078ce37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.438619 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251148d6-57bc-4e33-b6b1-73d67078ce37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:08.440095 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251148d6-57bc-4e33-b6b1-73d67078ce37 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:08.449831 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1447/2883] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:08.712001 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:08.713592 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.728346 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3605-4a57-4232-ac67-23cc4a72c879 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:08.733201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:08.734862 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.735154 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.735465 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] PATH_INFO: `/v3/projects/9836caef79c64603bba4250884f2100c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.736579 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9836caef79c64603bba4250884f2100c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:08.738508 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:08.785569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9836caef79c64603bba4250884f2100c', 'request_id': 'req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.791728 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9836caef79c64603bba4250884f2100c', 'request_id': 'req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.799264 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9836caef79c64603bba4250884f2100c', 'request_id': 'req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.810477 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] The token cache is being invalidate because project 9836caef79c64603bba4250884f2100c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:32:08.810765 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.811376 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5048ff0-24f4-4c87-a5a5-4b7ff62bd0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:08.812985 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1437/2884] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:32:08 2022] DELETE /identity/v3/projects/9836caef79c64603bba4250884f2100c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:08.818532 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.819036 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.819148 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.838494 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:08.839676 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.896896 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1448/2885] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:08.904311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.904628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.904907 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.924821 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:08.926032 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:08.933958 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1438/2886] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:08.937993 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:08.948215 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a5dcb-cf02-4e67-bfa4-606f62b36b12 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:08.952937 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:08.953540 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.953834 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.954092 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.954740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:32:08.955049 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:08.956691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:08.968782 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1449/2887] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:32:08.972954 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:08.981916 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198e36b-13d7-4420-bb54-17c3662136e6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:08.986447 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:08.987027 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:08.987335 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:08.987601 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:08.988251 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:08.990140 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:09.016531 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1439/2888] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:32:08 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:32:09.020666 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:09.030565 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c001237-dfef-496e-9a9a-e4eb6f7f6c58 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:09.085748 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:09.086296 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:09.086606 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:09.086854 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:09.087511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:09.089450 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:09.110948 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1450/2889] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:32:09 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:32:09.115553 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:09.125572 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57dbe5-e110-4fdc-832a-4d14423be8bd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:09.130095 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:09.130686 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:09.130968 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:09.131237 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:09.131870 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:09.133512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:09.143080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1440/2890] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:32:09.147335 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:09.157041 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437e0b1-6530-4dbb-be51-e2787ceb0403 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:09.162409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17f48-bb2c-4fee-ad0a-0b5d349df0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:09.162996 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17f48-bb2c-4fee-ad0a-0b5d349df0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:09.163276 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17f48-bb2c-4fee-ad0a-0b5d349df0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:09.163548 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17f48-bb2c-4fee-ad0a-0b5d349df0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:09.164219 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17f48-bb2c-4fee-ad0a-0b5d349df0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:09.165806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17f48-bb2c-4fee-ad0a-0b5d349df0fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:09.176409 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1451/2891] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:32:09.180433 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:09.190322 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d5bd3-4579-4c2e-a309-4db1655185b5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:09.194820 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:09.195470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:09.195749 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:09.196131 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] PATH_INFO: `/v3/projects/90be8e26a221485d919d31e74877cdb6/users/4b69118f6de84c1aa1886d2902a8673c/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:09.210670 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90be8e26a221485d919d31e74877cdb6, user_id=4b69118f6de84c1aa1886d2902a8673c, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:09.213366 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:09.226080 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1441/2892] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:32:09 2022] PUT /identity/v3/projects/90be8e26a221485d919d31e74877cdb6/users/4b69118f6de84c1aa1886d2902a8673c/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 14:32:09.235836 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:09.236145 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:09.236422 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:09.263074 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] MFA Rules not processed for user `4b69118f6de84c1aa1886d2902a8673c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:09.264316 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:09.273738 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:09.328916 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1452/2893] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:09.339918 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:09.341972 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:09.413017 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:09.418569 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ece7-e0d9-4411-95eb-2a21549c4be9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:09.423178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74c45-3130-48a0-800e-4a28a55e6bd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb472deed9140dcbb47301a3871a21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:09.423785 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74c45-3130-48a0-800e-4a28a55e6bd9 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:09.424109 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74c45-3130-48a0-800e-4a28a55e6bd9 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:09.424381 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74c45-3130-48a0-800e-4a28a55e6bd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:09.433213 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74c45-3130-48a0-800e-4a28a55e6bd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:09.434647 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74c45-3130-48a0-800e-4a28a55e6bd9 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:09.443313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1442/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:19.326023 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=22 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:19.439370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:24.910740 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:24.971488 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9523ad-802b-45e1-8f93-f0850feb13e0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:24.975885 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:24.976527 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:24.976806 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:24.977075 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] PATH_INFO: `/v3/users/4b69118f6de84c1aa1886d2902a8673c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:24.978170 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b69118f6de84c1aa1886d2902a8673c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:24.980756 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.023172 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b69118f6de84c1aa1886d2902a8673c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.023800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b69118f6de84c1aa1886d2902a8673c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.024486 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b69118f6de84c1aa1886d2902a8673c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.036985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b69118f6de84c1aa1886d2902a8673c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.044435 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b69118f6de84c1aa1886d2902a8673c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.057495 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1453/2895] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:32:24 2022] DELETE /identity/v3/users/4b69118f6de84c1aa1886d2902a8673c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:25.061923 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c434512-5a00-4150-842b-100114737f61 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.062397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c434512-5a00-4150-842b-100114737f61 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.062513 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c434512-5a00-4150-842b-100114737f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.080676 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2c434512-5a00-4150-842b-100114737f61 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:25.081863 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c434512-5a00-4150-842b-100114737f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:25.138276 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1443/2896] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:25.148025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.149405 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:25.205811 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30752-f52d-48db-9278-1abe9e68cc85 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.209408 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc891e7a-450e-43b5-b5db-f0c3001b111c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.210007 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc891e7a-450e-43b5-b5db-f0c3001b111c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.210283 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc891e7a-450e-43b5-b5db-f0c3001b111c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.210553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc891e7a-450e-43b5-b5db-f0c3001b111c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.220434 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc891e7a-450e-43b5-b5db-f0c3001b111c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.221929 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc891e7a-450e-43b5-b5db-f0c3001b111c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.231771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1454/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:25.491370 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c434512-5a00-4150-842b-100114737f61 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.492878 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c434512-5a00-4150-842b-100114737f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:25.505079 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c434512-5a00-4150-842b-100114737f61 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.509629 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.510259 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.510538 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.511315 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] PATH_INFO: `/v3/projects/90be8e26a221485d919d31e74877cdb6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.512467 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90be8e26a221485d919d31e74877cdb6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.514371 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.560308 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90be8e26a221485d919d31e74877cdb6', 'request_id': 'req-c9783ff8-f525-4b58-9df6-66f8c85dc592'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.565799 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90be8e26a221485d919d31e74877cdb6', 'request_id': 'req-c9783ff8-f525-4b58-9df6-66f8c85dc592'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.572794 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90be8e26a221485d919d31e74877cdb6', 'request_id': 'req-c9783ff8-f525-4b58-9df6-66f8c85dc592'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.583937 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] The token cache is being invalidate because project 90be8e26a221485d919d31e74877cdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:32:25.584255 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.584874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c9783ff8-f525-4b58-9df6-66f8c85dc592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:25.586313 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1444/2898] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:32:25 2022] DELETE /identity/v3/projects/90be8e26a221485d919d31e74877cdb6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:25.592000 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.592311 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.592671 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.613125 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:25.614319 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:25.631056 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:25.673572 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1455/2899] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:25.680818 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.681110 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.681390 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.701491 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:25.702690 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:25.710521 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1445/2900] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:25.714632 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.724294 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd456-ac31-495d-ab93-bdf9f6542642 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.728769 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.729744 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.730025 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.730289 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.730926 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 14:32:25.731221 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.732842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.745511 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1456/2901] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 17 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 14:32:25.749254 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.758489 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb01e-82a6-4248-85b5-00c452e16210 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.763628 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.764256 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.764536 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.764805 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.765415 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.767311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.794122 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1446/2902] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 17 14:32:25 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:32:25.798507 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.808849 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2de7e-efd7-4e5c-a57e-798c8986750b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.864775 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.865293 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.865578 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.865842 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.866443 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.868448 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.888905 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1457/2903] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 17 14:32:25 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 14:32:25.893311 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.903896 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43139a-a904-430c-a986-ed7a9f971d5c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.908474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.909062 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.909341 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.909616 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.910283 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.911874 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.922284 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1447/2904] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:32:25.926120 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.936119 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4737c0-10c0-4392-97d4-e63c5ea63558 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.940796 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f8792-c28b-4c16-8a0b-2103dc834c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.941384 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f8792-c28b-4c16-8a0b-2103dc834c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.941662 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f8792-c28b-4c16-8a0b-2103dc834c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.941934 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f8792-c28b-4c16-8a0b-2103dc834c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.942570 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f8792-c28b-4c16-8a0b-2103dc834c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.944187 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f8792-c28b-4c16-8a0b-2103dc834c8a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:25.954481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1458/2905] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 17 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 14:32:25.958317 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:25.969480 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c60814-6a74-4ee9-8dac-b8588708b0d5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:25.974065 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:25.974702 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:25.974984 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:25.975257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] PATH_INFO: `/v3/projects/3ec3f924e2a64efbad366b84a2349a55/users/7891ae5355514c1d98e3c872eddebb09/roles/cd1209cf9c93469fab17d5f0e1fea91e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:25.989855 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec3f924e2a64efbad366b84a2349a55, user_id=7891ae5355514c1d98e3c872eddebb09, role_id=cd1209cf9c93469fab17d5f0e1fea91e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:25.992577 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:26.005199 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1448/2906] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 17 14:32:25 2022] PUT /identity/v3/projects/3ec3f924e2a64efbad366b84a2349a55/users/7891ae5355514c1d98e3c872eddebb09/roles/cd1209cf9c93469fab17d5f0e1fea91e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:26.015800 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:26.016131 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:26.016402 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:26.044048 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] MFA Rules not processed for user `7891ae5355514c1d98e3c872eddebb09`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:26.045280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:26.108608 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1459/2907] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:26.119683 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:26.121356 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:26.142976 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:26.179586 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4bc8b-5bc7-43f9-93c0-75f07f712600 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:26.183250 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71397cc-de29-4eaa-821d-2011f7bdf9ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bd62078f127457392fa0dd755ed1a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:26.183886 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71397cc-de29-4eaa-821d-2011f7bdf9ed service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:26.184201 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71397cc-de29-4eaa-821d-2011f7bdf9ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:26.184474 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71397cc-de29-4eaa-821d-2011f7bdf9ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:26.192530 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71397cc-de29-4eaa-821d-2011f7bdf9ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:26.193957 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71397cc-de29-4eaa-821d-2011f7bdf9ed service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:26.203029 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1449/2908] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:36.105691 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:36.198618 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=17 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:32:56.884983 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:56.946915 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f8644-6272-4ee7-80e3-785ba361a256 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:56.951359 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:56.951997 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:56.952285 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:56.952553 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] PATH_INFO: `/v3/users/7891ae5355514c1d98e3c872eddebb09` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:56.953673 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7891ae5355514c1d98e3c872eddebb09)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:56.955702 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:57.000524 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7891ae5355514c1d98e3c872eddebb09'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.001086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7891ae5355514c1d98e3c872eddebb09'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.001681 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7891ae5355514c1d98e3c872eddebb09'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.013725 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7891ae5355514c1d98e3c872eddebb09'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.020377 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7891ae5355514c1d98e3c872eddebb09'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.032426 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1460/2909] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 17 14:32:56 2022] DELETE /identity/v3/users/7891ae5355514c1d98e3c872eddebb09 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:32:57.036959 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:57.037470 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:57.037581 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:57.057257 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] MFA Rules not processed for user `d6d936d32ad542fba7a707cd7eda404b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 14:32:57.058454 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:57.114321 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1450/2910] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 17 14:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 14:32:57.124963 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:57.126362 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:57.182261 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d066b36-2759-449a-a64d-b53bce62f964 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:57.185840 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df436d79943414185c4a6c5c6f9c5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:57.186439 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:57.186715 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:57.186985 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:57.195724 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:57.197181 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:57.206481 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1461/2911] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:32:57.464178 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:32:57.465648 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:32:57.478141 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12322b-b567-49bf-b553-e776d65ca3bc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:32:57.482680 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d936d32ad542fba7a707cd7eda404b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3648060d3e5b42e78dece5e6598cf094', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:32:57.483316 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:32:57.483595 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:32:57.483869 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] PATH_INFO: `/v3/projects/3ec3f924e2a64efbad366b84a2349a55` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:32:57.485028 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec3f924e2a64efbad366b84a2349a55)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:32:57.486940 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:32:57.532073 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec3f924e2a64efbad366b84a2349a55', 'request_id': 'req-ab29f4ad-b9f9-4253-8594-40bacffa49cb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.537397 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec3f924e2a64efbad366b84a2349a55', 'request_id': 'req-ab29f4ad-b9f9-4253-8594-40bacffa49cb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.545288 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec3f924e2a64efbad366b84a2349a55', 'request_id': 'req-ab29f4ad-b9f9-4253-8594-40bacffa49cb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.556512 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] The token cache is being invalidate because project 3ec3f924e2a64efbad366b84a2349a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 14:32:57.556747 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.557367 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ab29f4ad-b9f9-4253-8594-40bacffa49cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 14:32:57.558904 dv-cinder-820027-18-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1451/2912] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 17 14:32:57 2022] DELETE /identity/v3/projects/3ec3f924e2a64efbad366b84a2349a55 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 14:33:07.202380 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:07.553162 dv-cinder-820027-18-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:41.351789 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 14:33:41.353252 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:33:41.424030 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2daa71-faed-40aa-a1ee-d25e545e483a service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 14:33:41.483086 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70af8d78a61a4155a37c330b19123a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe1e0d446112470b9a842113084ce3b0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 14:33:41.484225 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 14:33:41.484502 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 14:33:41.484771 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 14:33:41.486457 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 14:33:41.501280 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 14:33:41.503790 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693bbdb-2bd2-48b7-bea0-3f1a57bf9571 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 14:33:41.513833 dv-cinder-820027-18-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1462/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Aug 17 14:33:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 14:33:51.509569 dv-cinder-820027-18-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=58 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}